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ABSTRACT 


V 

Ralph  Gomory  has  recently  aroused  interest  in  a  special  type  of 
knapsack  problem  in  which  the  constraint  coefficients  and  constant  term 
are  elements  of  a  finite  additive  group.  The  significance  of  this  prob¬ 
lem  lies  in  the  fact  that  it  is  closely  related  to  the  general  integer 
linear  programming  problem,  resulting  by  removing  the  nonnegativity  re¬ 
strictions  on  those  variables  in  the  general  problem  that  lie  in  an 
optimal  basis  for  the  associated  linear  program. 

Gomoiry  has  shown  how  to  solve  the  special  knapsack  problem  by 
adapting  a  dynamic  programming  recursion  originally  designed  for  the 
ordinary  knapsack  problem,  and  has  identified  sufficient  conditions 
under  which  the  solution  of  the  special  knapsack  problem  will  satisfy 
the  nonnegativity  requirements  in  the  general  integer  program,  thereby 
yielding  an  optimal  solution  to  that  problem  as  well. 

In  this  paper  present  an  algorithm  for  solving  the  special  knap¬ 
sack  problem  that  is  capable  of  accommodating  a  variety  of  constraints 

J 

in  addition  to  the  special  knapsack  constrednt.  Our  purpose  in  doing 
this  is  to  expand  the  range  of  problems  for  which  the  optimal  solution 
for  the  special  problem  will  also  provide  an  optimal  solution  to  the 
general  integer  program  from  which  it  was  derived. 

We  develop  the  algorithm  in  a  general  framework  that  eilso  permits  a 
direct  application  to  solving  the  general  integer  programning  problem 
and  certain  nonlinear  integer  problems  without  attempting  to  solve  the 
special  knapsack  problem.  Some  of  the  results  developed  can  also  be 
exploited  by  integer  programming  algorithms  other  than  the  one  of  this 


paper . 


1.  Introduction 


We  represent  the  ordinary  linear  progranming  problem  as  that  of 
finding  an  n  x  1  vector  x  and  an  n  x  1  vector  z  to 
(l)  Minimize  cx 

subject  to  Ax  +  z  =  b,  x  ^  0,  z  ^  0, 
where  A,  b,  and  c  are  matrices  of  constants  with  dimensions  m  x  n,  m  x  1, 
and  n  X  1,  respectively.  We  assume  for  convenience  that  the  ccmonical 
form  (l)  has  been  obtained  by  the  simplex  method  applied  to  a  linear  pro¬ 
gram  that  was  initially  in  a  corresponding  form,  but  which  in  (l)  adso 
satisfies  the  primal  and  dual  feasiblHty  criteria,  b  i  0  and  c  2  0.^  As 
is  well  known,  an  optimal  solution  to  (l)  is  then  given  by  x  =  0  and 
z  =  b. 

Hereafter,  we  specify  the  components  of  z  and  x  to  be  integers, 
whereupon  (l)  represents  a  pure  integer  programming  problem.  Following 
Gomory  [5]»  if  we  relax  the  requirement  z  k  0,  the  constraint  set  of  the 
problem  becomes  Ax  =  b  (mod  l),  x  k  0  euid  integer.  We  may  replace  b 
with  any  vector  A^  such  that  A^  =  b  (mod  l),  and  similarly  replace  the 
jth  column  of  A  with  any  vector  Aj  which  is  its  equivalent  modulo  1, 
without  altering  the  set  of  feasible  solutions  x.  In  particular,  we 
may  drop  the  integer  parts  of  the  components  of  A  and  b,  so  that  the 
entries  of  the  A^  are  nonnegative  and  less  than  1.  Let  us  then  write 
the  relaxed  integer  problem  as 


s 

and  where,  by  assus^tion,  c.  k  0  for  all  j.  Given  that  the  coiii^)onents 

t) 


ubject  to 


z 


A  (mod  1),  X  ft  0  and  integer. 


(2 )  Minimize 


I 
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The  original  problem  is  assumed  to  have  a  finite  optimal  solution. 


2 


of  A°  and  b°  are  integers,  where  A°  and  denote  the  original  A  matrix 

and  b  vector  that  were  transformed  to  obtain  the  primal  and  dual  feasible 

form  of  (l),  Gomory  [4]  has  shown  that  the  vectors  u  satisfying 

n 

u  =  )  A.y.  for  integer  y. 

.  s  t)  J  3 

J=0 

are  elements  of  a  finite  additive  groiQ)  of  order  D,  where  D  is  the  abso¬ 
lute  value  of  the  determinant  of  the  matrix  that  was  inverted  by  the 
simplex  method  to  yield  (l)  in  its  primal  and  dual  feasible  canonical 
form. 

2.  Integer  Solutions  to  (l)  and  (2) 

It  is  clear  that  an  optimal  solution  x*  to  (2)  wiD.l  not  necessarily 
provide  an  optimal  solution  (x*,  z*)  to  (l),  where  z*  =  b  -  Ax*,  since 
the  components  of  z*  may  not  all  be  nonnegative.  However,  it  might  be 
hoped  that  the  solution  to  (2)  will  extend  optimally  to  (l)  in  this  fash¬ 
ion,  and  Gomory  [5I  has  indicated  some  of  the  conditions  under  which  this 
will  occur. 

In  order  to  solve  (2),  Gomory  proposed  a  variant  of  a  dynamic  pro¬ 
gramming  recursion  for  the  knapsack  problem  developed  jointly  with  Paul 
Gilmore  [2].  Some  refinements  and  improvements  in  this  dynamic  program¬ 
ming  recursion  applied  to  problem  (2)  have  been  suggested  by  W.  W.  White 
[6],  and  undoubtedly  this  approach  merits  further  consideration  and  elab¬ 
oration. 

In  this  paper,  however,  we  propose  a  different  method  for  solving  (2) 
that  is  expressly  designed  to  accommodate  a  number  of  additional  restric¬ 
tions  on  those  x^  which  are  admitted  as  feasible.  The  ability  to  handle 
such  restrictions  may  be  desirable  either  because  they  apply  directly  to 


the  X.  which  are  feasible  for  (l),  or  because  they  apply  implicitly  to 
J 

the  Xj  in  order  to  assure  that  z  ^  0.  This  ability  may  also  be  desirable 
if  one  elects  to  solve  (l)  by  partitioning  the  less  constrained  solution 
space  of  (2)  in  a  manner  to  yield  a  series  of  problems,  the  solution  to 
one  of  which  will  give  an  optimal  solution  to  (l).  We  develop  the  method 
of  this  paper  in  a  general  form  that  may  also  be  directly  applied  to 
solve  problem  (l),  and  problems  more  general  than  (l).  However,  because 
the  method  seems  particularly  suited  to  exploiting  certain  structures 
that  arise  in  connection  with  problem  (2),  a  procedure  that  tekes  advantage 
of  this  characteristic  of  the  method  may  in  some  instances  prove  more 
effective  for  solving  (l)  than  a  completely  direct  application  of  the 
method. 


In  our  approach  we  generate  a  sequences  of  solutions  x(i)  * 


The  cost  associated  with  x(i)  is  denoted  by  c(i)  » 


Likewise,  we  associate  with  x(i)  the  group  element  A(i)  = 

We  construct  S  so  that  it  satisfies  the  following  conditions: 


1.  If  p  q,  then  x(p)  f  x(q). 

2.  If  p  <  q,  then  c(p)  S  c(q). 

3.  x(i)  is  an  optimal  solution  to  (2)  when  is  replaced  by  A(i). 

4.  S  is  finite,  and  A(i)  ==  A^  for  some  x(i)  in  S  if  and  only  if 
problem  (2)  has  a  feasible  solution. 

If  we  alternately  interpret  the  A^  as  ordinary  column  vectors,  and 
interpret  equivalence  modulo  1  as  ordinary  equality,  our  strategy  in 


k 


generating  S  nay  be  seen  to  correspond  quite  closely  to  the  strategy  of 
the  dual  simplex  method  in  solving  the  ordinary  linear  prograomlng  prob¬ 
lem,  since  the  successive  basic  solutions  determined  by  the  pivot  rules 
of  the  dual  sinplex  method  satisfy  exactly  the  sane  four  conditions. 

Rather  than  employ  pivot  transformations  to  carry  us  from  one  term  of 
the  sequence  to  the  next,  however,  we  resort  to  a  procedure  of  truncated 
enumeration.  Truncated  enumeration  methods  are  in  general  cheiracterized 
by  an  abbreviated  search  over  a  tree  of  all  possible  solutions,  amd  de¬ 
rive  their  efficiency  from  the  ability  to  exclude  certain  branches  of 
the  tree  from  consideration,  so  that,  when  the  criteria  for  exclusion 
are  sufficiently  effective,  only  a  small  fraction  of  the  potentially 
vast  number  of  alternatives  need  ever  be  generated  or  examined. 

The  ^rhoice  rule  that  leads  to  a  sequence  of  solutions  satisfying 
the  four  conditions  listed  above  is  called  the  least  cost  rule  (see  [3])» 
and  is  closely  related  to  a  shortest  path  algorithm  due  to  G.  B.  Dantzig 
[ll.  However,  while  the  least  cost  rule  is  customarily  given  as  finding 
a  minimum  over  a  generally  enlarging  set  of  nodes  of  a  solution  tree, 
our  approach  prescribes  this  determination  over  a  constant  or  decreasing 
set  of  arc  classes,  the  arc  class  J  consisting  of  those  arcs  of  the  tree 
along  which  Xj  is  assigned  a  value. ^  The  strategy  underlying  our  algorithm 
is  to  imbed  this  varlsint  of  the  least  cost  rule  in  a  framework  that 
permits  its  properties  to  be  exploited  in  a  computationally  efficient 
manner. 


See  [3]  for  a  discussion  of  the  least  cost  and  other  rules  in  terms 
of  tree  representation. 
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3.  The  Algorithm 

Vic  desii^nate  problem  (3)  to  be  the  problem  having  the  same  objective 
function  as  (2),  but  with  an  unspecified  constraint  set,  possibly  non¬ 
linear.  Our  general  approach  will  then  apply  directly  to  solving  problem 
(3)  in  nonnegative  integer  variables.  After  developing  the  suitable  propo¬ 
sitions  underlying  the  method  in  the  general  case,  we  will  subsequently 
introduce  the  specializations  appropriate  to  solving  those  particular 
problems  around  which  our  concern  centers. 

Vic  introduce  the  following  definitions  and  notation.  A  vector  x  will 
be  called  a  continuation  of  a  vector  y  if  x  =  y  +  z  for  some  integer  vector 
z  k  0.  Vie  call  x  a  simple  continuation  of  y  if  x  =  y  +  e^  for  some  j, 
where  e.  is  the  vector  having  its  component  equal  to  1  and  all  re- 
maining  components  0. 

In  generating  the  sequence  of  solutions  x(0),  x(l),  ...  to  obtain 
an  optimal  solution  to  problem  (3),  we  specify  that  x(0}  =  0,  and  that 
each  x(i)  is  a  simple  continuation  of  some  x(k),  k  <  1.  (Note  that 
x(k+l)  may  not  be  a  simple  continuation,  or  any  continuation,  of  x(k).) 

To  assure  that  the  sequence  of  solutions  generated  will  satisfy  this  con¬ 
dition,  and  other  conditions  that  we  vrill  subsequently  impose,  we  asso¬ 
ciate  vrith  every  nonnegative  integer  vector  x  a  set  of  vectors  R(x),  and 
say  that  the  vector  y  is  a  permissible  continuation  of  x  if  y  =  x  +  z 
for  z  e  R(x).  The  set  R(x)  will  be  defined  to  consist  of  all  nonnegative 
z  /  0  such  that  r  S  s,  where  z^  is  the  last  nonzero  component  of  z  and 
x^  is  the  first  nonzero  conponent  ofx  (s  =  n  if  x  =  O).  Vie  also  define 
Rj^(x)  to  be  the  set  of  all  z  e  R(x)  such  that  y' z^  =  k.  Thus,  the  sinple 
continuations  generated  from  x  in  S  are  those  vectors  of  the  form  x  +  z, 

Z  €  R^(x). 
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In  what  follows  we  will  ■vreint  to  refer  to  t\70  sequences  of  vectors, 

S  and  S.  The  parent  sequence  S  consists  of  every  nonnegative  integer 
vector  that  yields  an  objective  function  value  cx  less  than  or  equal  to 
the  optimal  value  for  problem  (3)*  We  will  specify  a  procedure  for 
generating  the  components  of  S  in  a  certain  order  which  satisfies  (with 
sli^t  modification)  the  conditions  1  -  4  of  the  preceding  section.  In 
addition,  this  order  will  exhibit  other  properties  that  carry  over  to 
the  contracted  sequence  S,  which  is  actually  the  sequence  we  will  be 
interested  in  generating.  The  procedure  for  generatir^g  S  differs  from 
that  used  to  generate  S  in  that  rules  are  employed  that  permit  certain 
subsequences  of  solutions  in  S  to  be  bypassed  without  receiving  consid¬ 
eration. 

To  specify  the  nature  of  these  rules,  we  introduce  the  sequences 
and  which  denote  the  portions  of  the  completed  sequences  S  and  S 
that  are  generated  as  of  some  particular  stage.  Thus,  at  the  point  at 
which  the  kth  solution  in  S  has  just  been  generated,  S  consists  of  the 
x(i)  for  i  =  0,  1,  ...,k. 

Just  as  the  permissible  continuations  of  those  x  in  are  restricted 
by  requiring  that  they  assume  the  form  x  +  z,  z  e  R(x),  we  shall  require 
(define)  that  the  permissible  continuations  of  the  x  in  assume  the 
form  X  +  z  for  z  €  R(x),  where  R(x)  is  some  subset  of  R(x)  to  be  speci¬ 
fied  subsequently. 

Let  S*  denote  the  set  of  all  optimal  solutions  in  S,  and  S*  corre¬ 
spondingly  denote  the  set  of  all  optimal  solutions  in  S.  Then  it  is  evi¬ 
dent  from  our  discussion  of  S  that  S*  must  be  nonenqoty  whenever  an  optimal 
solution  to  problem  (3)  exists.  We  will  of  course  want  the  rules  for  dis¬ 
carding  continuations  in  S  to  assure  that  S*  ^  implies  S*  ^  As  a 


basis  for  accon^lishing  this  we  introduce  two  types  of  dominance  rela¬ 
tions. 
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Ordinary  dominance:  We  will  say  that  a  vector  x  dominates  a  vector 
y,  or  ;>dDy,  if  for  every  z  ^  0  such  that  y  +  z  is  optimal  for  problem  (3), 

X  +  z  is  also  optimal. 

Local  dominance:  We  will  say  that  x  locally  dominates  y  with  respect 
to  the  sequence  S  ,  or  xDy,  if  x  +  z  is  optimal  for  every  z  e  R(y)  such 
that  y  +  z  is  optimal. 

It  is  to  be  noted  that  local  dominance  depends  on  the  particular 
stage  in  generating  S  to  which  one  has  reference.  Generally,  if  at  some 
point  a  vector  y  has  no  (permissible)  continuations  that  are  optimal, 
then  y  is  (locally)  dominated  by  every  vector  x. 

We  may  also  observe  in  passing  that  the  relations  D  and  D  are  both 
reflexive,  and  that  they  are  neither  symmetric  nor  antisymmetric.  On 
the  other  hand,  D  is  associative,  but  D  is  not.  Si>ecifically,  vSv,  vDw 
implies  uDw  if  and  only  if  ^(w)  c  R*(v),  where,  for  any  x,  R*(x)  is  the 
(possibly  empty)  subset  of  R(x)  such  that  z  e  R*(x)  implies  x  +  z  is 
optimal. 

There  are  two  principal  rules  based  on  the  foregoing  remarks  that 
will  enable  the  procedure  for  generating  S  to  be  transformed  into  the 
procedure  for  generating  S.  They  are: 

Rule  1.  Ifx€S,y/^S,  and  xDy,  then  all  v  such  that  v  i  y  may 
be  eliminated  from  G . 

Rule  2.  If  X  €  S.,  y  ^  S_,  and  then  y  and  all  v  such  that 
V  =  y  +  z,  z  e  R(x),  may  be  eliminated  from  S. 

By  reference  to  Rules  1  and  2,  we  now  define  R(x)  (or,  conveniently, 
R(u)).  Specifically,  for  u  e  S,  define  R(u)  relative  to  to  be  that 
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subset  of  R(u)  such  that,  w  €  (R(u)  -  if  and  only  if  there  exist 
X  e  y  whore  y  is  an  earlier  corponent  of  G  than  u,  such  that, 
for  V  =  u  +  w, 


(i)  xDy  and  v  s:  y,  or 

(ii)  ^y  and  either  v  =  yorv=y  +  2,  zc  R(y). 

It  may  be  noted  that  the  requirement  that  y  is  an  earlier  cooponent  of 
G  than  u  avoids  certain  problems  of  circularity,  and,  as  we  will  see, 
also  brings  the  definition  of  R(u)  into  correspondence  with  the  informa¬ 
tion  available  from  the  algorithm  at  the  point  at  which  a  decision  is 
made  to  include  or  exclude  u  from  S.  That  is,  R(u)  limits  the  permiBsible 
continuations  of  u,  at  the  time  u  is  under  consideration  as  a  potentieJL 
element  of  C,  to  those  permissible  continuations  of  u  in  S  that  do  not 
qualify  to  be  dropped  by  Rule  1  or  Rule  2. 

The  procedure  for  generating  3  and  S  is  then  as  follows.  Associated 

•  •  • 

with  the  vector  x(i)  =  (x^,  x^,  ...,  x^)  €  S,  we  define  d^  =  Min(j: 

Xj  *5  l)  if  i  ^  1,  and  d^  =  n.  Thus,  z  e  Rj^(x(i))  if  and  only  if  z  =  e^ 
for  some  J  ^  d^. 

We  also  wish  to  identify  the  vector  x(t.)  such  that  t^ie  next  vector 

J 

x(k)  of  the  form  x(i)  +  e  ,  to  be  added  to  S  will  be  given  by  x(k)  = 

J  ^ 

x(t.)  +  e.  for  some  j.  The  identification  is  accomplished  (as  will  be 
i)  J 

proved)  if  we  initially  define  t,.  =  0  for  all  j,  and  then  define  the  "next 

value"  t.  of  t .  so  that  t .  =  I4in(i:  i  >  t.  and  j  -  d, ),  where  t.  is 

assigned  its  next  value  t.  iranediately  after  the  solution  x(t.)  +  e.  is 

J  1  J 

added  to  S  .  It  is  possible  that  some  of  the  t .  may  not  be  well-defined 
c  j 

at  a  particular  stage  of  generating  G,  and  consequently  we  must  also 


identify  the  set  T  relative  to  a  given  which  consists  of  those  j  such 
that  t.  is  currently  well-defined. 
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Finally,  to  determine  the  j  which  is  to  contribute  the  next  vector 

in  S  ,  we  define  the  "next  cost"  associated  with  each  J  to  be  N.  = 

c(t.)  +  c..  The  foregoing  definitions  of  d. ,  t.,  T  and  N.  are  under- 
0  0  i  0  0 

stood  to  apply  to  S  as  v;ell  as  to  S  by  replacing  each  occurrence  of  S 

ana  S  respectively  with  S  and  S  . 

0  0 

The  Algorithm 

Beginning  with  x(0)  =  0,  assume  that  x(i)  has  been  generated  for 
i  =  0,  1,  k-1.  The  procedure  to  follow  is  designed  to  generate  S 

with  instruction  2  removed,  and  to  generate  S  with  instruction  2  present. 

1.  If  T  is  en5>ty,  (3)  has  no  feasible  solution  and  there  is  no  kth 

term  to  be  generated.  Otherwise,  let  J  be  determined  by  N  = 

J 

Min(N.:  j  e  T).^  If  there  is  more  than  one  candidate  for  J, 

J 

select  the  one  for  which  J  is  the  smallest. 

2.  If  the  solution  x(t  )  +  e  satisfies  the  criteria  to  be 

J  J 

eliminated  by  Rule  1  or  Rule  2,  assign  t_  its  next  value  t_ 

J  J 

and  return  to  1.  Otherwise, 

3.  Let  x(k)  =  x(t  )  +  e  .  If  x(k)  is  feasible  for  (3)  (hence  the 

J  J 

first  feasible  solution  found),  then  x(k)  is  optimal  and  the 
problem  is  solved.  Otherwise, 

4.  Assign  t  its  next  value  t  ,  increment  k  by  1,  and  return  to  1. 

J  J 


There  are  several  things  to  be  observed  about  the  general  framework 
of  the  method  as  described  above.  First,  the  process  specified  in  instruc¬ 
tion  2,  v^hereby  x(t  )  +  e  is  bypassed,  corresponds  precisely  to  setting 

J  J 

R(x(t  )  +  e  )  =  0,  since  failing  to  include  a  solution  in  S  immediately 
J  J 

eliminates  all  permissible  continuations  (though  not  all  continuations)  of 

^  It  is  not  necessary  to  compute  a  minimum  over  all  elements  of  T  each 
time  Nj  is  determined,  since  only  one  of  the  Nj  is  changed  at  each  step. 
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that  solution.  VJhen  Rule  1  applies  to  justify  the  elimination  of  all  con¬ 
tinuations  of  a  solution,  the  method  thus  accomplishes  this  by  successively 
eliminating  certain  sets  of  permissible  continuations . 

Second,  the  description  of  the  method  does  not  specify  either  the 
record  keeping  or  the  tests  underlying  Rules  1  and  2  that  enable  the 
elimination  of  solutions.  \Je  reserve  this  specification  to  later  sections, 
where  we  introduce  several  important  modifications  and  refinements  of  the’ 
general  framework  outlined  above. 

It  may  also  be  observed  that,  while  ve  have  earlier  defined  d^  = 

14in(j:  ^  l),  each  d.  may  be  determined  more  simply  by  assigning  d,  the 

value  J  at  instruction  4.  This  is  clearly  true  for  d^,  and  in  fact  for 
any  d,  =  J  such  that  t,.  =  0.  Assuming  that  it  is  true  for  all  d. ,  i  ^  k-1, 

it  must  also  be  true  for  i  =  k  since,  if  t^ji^  0,  then  t  =  p  for  some  p  <  k 

J  J 

such  that  d  =  J.  But  then  J  =  Min(j:  ^  l)  and  x(k)  =  x(p)  +  e^,  from 

P  J  ‘J 

which  d,  =  J  follovrs. 


4.  Justification  of  the  Algorithm:  Propositions  and  Proofs 

We  have  informally  made  a  number  of  claims  about  the  sequences  S  and 

5,  and  have  attempted  to  introduce  considerations  to  melee  some  of  these 
claims  intuitively  plausible.  We  will  ncr,!  present  our  claims  more  formally, 
explicitly  defining  S  and  S  to  be  those  respective  sequences  generated  by 
the  above  method  with  instruction  2  removed  and  vdth  instruction  2  present. 

We  will  require  in  what  foUa^s  tnat  problem  (3)  is  bounded  and  that 

c  >  0.  Given  rational  c .  >  0,  this  latter  can  be  assured,  for  example, 

0 

by  replacing  c  by  a  sufficient  positive  multiple  of  itself  to  assure  all 
coD5)onents  are  integer,  and  then  replacing  those  c  =  0  by  l/P,  where  P 

V 


is  a  number  such  that  '' 


)  X.  S 


P  -  1. 


Thus,  when  solving  problem  (2) 


4 


I 
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it  suffices  to  multiply  c  by  D,  and  also  to  let  P  =  D,  where  D  is  the 
value  of  the  determinant  referred  to  in  Section  1. 

Our  first  two  propositions  are  essentially  the  same  as  the  state¬ 
ments  of  conditions  1  and  2  in  Section  2. 

Proposition  1.  If  x(p),  x(q)  e  S,  or  if  x(p),  x(q)  e  S,  p  q, 
then  x(p)  f  x(q). 

Proof.  The  same  proof  applies  both  to  S  and  S.  Suppose  that  the 

proposition  is  false,  and  let  q  assume  the  least  value  such  that 

x(q)  =  x(p)  for  some  p  <  q.  Since  q  >  0,  x(q)  =  x(h)  +  e^  for 

some  h  <  q  and  r  =  d  .  Likewise,  since  x(p)  =  x(q)  f  0,  we  have 

p  >  0  and  x(p)  =  x(i)  +  e  for  some  i  <  p  and  s  =  d  .  But  by  the 

s  p 

definition  of  d  and  d  it  follows  that  r  =  s  and  hence  x(i)  = 
x(h).  We  must  have  i  =  h,  for  otherwise  a  duplication  occurred 
before  x(q)  was  generated,  contrary  to  assumption.  But  i  =  h  is 
also  impossible,  for,  given  that  t  =  i  when  x(p)  was  generated, 
tg  vras  then  strictly  increased  v;hen  assigned  its  next  value  t^,  and 
never  subsequently  decreased,  so  that  the  value  h  of  t  (also  t  ) 
when  x(q)  was  generated  could  only  have  been  larger  than  i. 

Proposition  2.  In  either  G  or  S,  if  p  <  q  then  c(p)  S  c(q). 

Proof.  Again,  the  same  proof  applies  both  to  S  and  S.  Note  to  begin 

\d.th  that  c(0)  S  c(l)  and  that  the  minimum  value  of  the  N.  after 

generating  x(l)  is  at  least  as  large  as  before.  Vie  assume  that  these 

t\70  conditions  hold  for  all  x(i),  i5k-l,  and  prove  that  they  must 

also  hold  when  generating  x(k).  For  some  h,  we  have  c(k-l)  =  = 

c(th)  +  ~  value  of  given  by 

c(t,  )  +  c,  ^  N,  since  t,  <  t,  S  k  -  1.  Thus  the  values  for  the  N. 

'  h''  n  h  h  h  j 

are  the  same  or,  in  the  case  of  N^,  possibly  increased  at  the  step 
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vhich  generates  x(k),  hence  the  minimum  value  of  the  is  also 
nondecreasing  and  c(k)  ^  c(k-l).  To  complete  the  proof  we  must  con¬ 
sider  the  case  in  which  t.  >  k-1.  In  this  instance  t,  is  not  de- 

h  h 

fined  upon  generating  x(k-l)  and  hence  the  set  T  is  decreased  by 
one  element  when  generating  x(k).  The  minimum  available  Nj  is  con¬ 
sequently  nondecreasing  and  again  (if  any  N.  remain)  c(k)  ^  c(k-l). 

J 

In  this  fashion  the  c(i)  continue  to  be  nondecreasing  until  the  un¬ 
defined  tj^  (or  some  other  undefined  t^)  becomes  defined  upon  gener¬ 
ating,  say,  x(q).  But  then  =  c(q)  +  Cj^,  which  is  at  least  as 
large  as  the  value  of  il^  that  produced  c(q)  (actually  exceeding  this 
value  for  c^  >  O),  so  that  the  minimum  available  remains  nondecreas¬ 
ing  at  all  steps. 


While  the  proofs  of  the  two  preceding  propositions  did  not  depend 
upon  c  >  0  or  the  precise  tiebreaking  rule  specified  by  the  method  for  the 
of  J,  the  proof  of  the  next  proposition  requires  both  of  these. 

Proposition  3«  In  S  and  S,  c(p)  =  c(q)  and  p  <  q  implies  x(p)  is 
lexicographically  larger  than  x(q). 

Proof.  By  x(p)  lexicographically  larger  than  x(q),  for  x(p)  f  x(q), 
we  mean  that  the  first  nonzero  conq)onent  of  x(p)  -  x(q)  is  positive. 
Assume  the  proposition  false,  and  denote  d^  by  r  and  d^  by  s .  We 
may  assume  s  <  r,  for  if  s  =  r  the  same  assumptions  concerning  the 
relation  between  x(q)  and  x(p)  must  aJLso  apply  to  x(q)  and  x(p)  (and 
conversely),  where  x(q)  =  x(q)  -  e  and  x(p)  =  x(p)  -  e  .  Hence, 
replacing  q  and  p  by  q  and  p  a  finite  number  of  times  permits  the 
assumption  s  <  r.  But  then,  N  was  not  defined  when  x(p)  was  created, 
or  else,  by  the  tiebreaking  rule  for  the  choice  of  J,  x(q)  would  have 
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been  generated  before  x(p).  Consequently,  when  becomes  defined, 
c(tg)  ^  c(p),  and  hence  c(q)  ^  c(p)  +  >  c(p),  contrary  to  assump¬ 

tion. 


The  next  proposition  is  the  first  that  does  not  apply  to  both  S  and  S. 
Proposition  4.  If  x(i)  €  S,  then  x  e  S  for  every  nonnegative  integer 
X  such  that  cx  <  c(i). 

Proof.  Assume  on  the  contrary  that  there  exists  a  nonnegative 
integer  x  such  that  cx  <  c(i)  and  x  ^  x(p)  for  all  p  <  i.  We  shall 
restrict  attention  to  those  x(p)  such  that,  for  some  r  ^  n,  x^  =  Xj 
for  all  J  >  r,  <  x^,  and  x^  =  0  for  j  <  r.  From  among  the  solu¬ 
tions  x(p)  so  restricted,  we  identify  the  solution  x(q)  which  is 
"closest"  to  X  as  follows.  We  stipulate  that  x(q)  is  that  solution 
for  which  r  is  the  smallest  and  such  that,  from  among  those  x(p)  with 
the  same  value  of  r,  x^  =  inax(x^).  Now  dir,  and  hence  when  x(q) 
is  generated  t^  S  q,  for  either  t^  <  q  or  t^  was  undefined  at  the 
point  at  which  x(q)  vms  generated,  in  which  case  t^  -  q.  Moreover, 
t^  ^  q  implies  N^  ^  c(q)  +  c^  ^  cx.  Thus,  since  d^  i  r,  and  since 
instruction  2  of  the  algorithm  is  removed,  before  generating  any  x(i) 
such  that  c(i)  >  cx,  the  method  must  first  generate  from  t^  and  x(q) 
the  solution  x(h)  =  x(q)  +  e^.  But  then  x(h)  qualifies  as  one  of  the 
restricted  solutions  x(p),  and  is  "closer"  to  x  than  x(q),  contrary 
to  the  choice  of  x(q). 


Remark  1.  If  problem  (3)  has  a  finite  optimal  solution,  then  S*  f 
Proof.  When  generating  S,  it  follows  from  Propositions  3  and  4  that 
T  can  be  empty  only  if  problem  (3)  has  no  feasible  solution.  (In  fact, 
vrith  instruction  2  removed  t^  must  always  be  well  defined  and  T  cannot 


be  empty  in  any  event.)  Suppose  that  the  optimal  objective  function 
value  is  c*,  but  that  no  optimal  solution  is  obtained  when  generating 
S.  Then  since  c  >  0,  Propositions  1  and  2  imply  that  c(i)  >  c*  for 
some  x(i)  c  S.  But  then,  by  Proposition  3>  each  x  such  that  cx  =  c*, 

X  S  0  and  integer,  will  have  been  generated  as  x(p)  for  some  p  <  i, 
contrary  to  assumption. 

Having  derived  the  foregoing  properties  of  the  sequences  S  and  S,  and 
having  verified  that  S*  0  when  problem  (3)  has  an  optimal  solution,  we 
now  wish  to  establish  that  S*  ^  0  as  well.  To  this  end  we  state 

Proposition  Assume  that  an  external  cutoff  rule  is  applied  to 
the  generation  of  S,  so  that,  if  the  method  does  not  stop  sooner  it 
will  stop  after  generating  M  terms  for  M  arbitrarily  large  but  finite. 
Also  assume  that  the  generation  of  S  is  allowed  to  continue  until  a 
solution  is  generated  vdth  an  objective  function  value  larger  than 
that  associated  with  every  solution  in  S.  Then  for  S  and  S  so  deter¬ 
mined,  S  is  a  subsequence  of  S. 

Pi’oof .  It  is  evident  from  Propositions  1  and  2  that  S  and  S  are  well- 

defined  by  the  assumptions  of  the  proposition.  Denote  those  x(i)  in 
1  —  2. 

S  by  X  (i)  6uid  those  x(i)  in  S  by  x  (i).  Let  S  be  the  subsequence 

1  12 

of  S  obtained  by  deleting  from  S  each  x  (i)  such  that  x  (i)  /  x  (k) 

2 

for  n-1 1  X  (k)  e  S.  V/e  note  by  Propositions  2  and  4  that  the  components 
of  S  must  correspond  to  those  of  S,  though  perhaps  in  a  different  order. 

Thus,  designate  the  smallest  i  such  that  x  (i)  e  S  by  0,  the  next 

—  1—2 
smallest  i  by  1,  and  so  on.  Then  we  wish  to  prove  that  x  (i)  =  x  (i) 

for  all  X  (i)  e  S.  Suppose  otherwise,  and  let  p  =  IIin(i:  x  (i)  ^ 

2  1—2 
X  (i)).  Also  identify  the  indices  q  and  r  such  that  x  (p)  =  x  (q) 

and  X  (p)  =  X  (r).  It  is  assured  by  Proposition  1  that  q,  r  >  p. 
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Since  i  =  s  if  and  only  if  i  =  s,  for  all  i  and  s,  we  have  x^(p’)  = 

X  (h)  +  for  some  u  and  some  h  <  p,‘  and  x  (p)  =  x  (k)  +  for 
some  V  and  some  k  <  p.  Now,  x^(p)  was  generated  before  x^(r),  but 
X  (r)  =  X  (p)  implies  x  (r)  =  x  (k)  +  e^.  Since  k  <  p,  this  means 
that  when  x^(p)  was  generated,  t^  (  =  k)  was  well-defined.  Thus 
there  was  a  choice  to  make  between  generating  x^(p)  and  x^(r). 
Similarly,  x  (p)  was  generated  before  x  (q),  but  x  (q)  =  x  (h)  +  e^, 
so  that,  by  analogous  reasoning,  there  was  a  choice  to  make  between 
generating  x  (p)  and  x  (q)  v/hen  x  (p)  was  generated  in  S.  But  p  <  r 
thus  implies  q  <  p,  providing  a  contradiction. 

To  demonstrate  that  S*  ^  implies  S*  0  ,  we  prove  the  somewhat 
stronger  result  to  follow. 

Proposition  6.  If  z  ^  0  and  y  +  z  is  optimal  for  some  y  ^  0,  then 
there  exists  a  solution  u  in  S  such  that  u  +  z  is  optimal. 

To  prove  Proposition  6  we  must  for  the  first  time  take  into  account 
the  properties  of  the  relations  D  and  D,  and  hence  of  the  sets  R(x)  and 
R(x). 

We  begin  by  observing  three  things,  the  proofs  of  which  are  immediate 
from  our  earlier  definitions . 

Remark  2.  If  y  e  R^(x),  z  e  Rj^(x),  then  y  +  z  e 
Remark  3.  If  y  e  Rjj(x),  z  €  Rj^(y),  then  y  +  z  e 
Remzirk  4.  R(y  +  z)  c  R(y),  R(z). 

It  may  be  noted  that  noted  that  Remarks  2  and  3  are  also  true  with  the 
subscripts  h  and  k  removed.  We  then  have 

Remark  If,  relative  to  some  S^,  Rule  2  prescribes  the  elimination 


of  all  solutions  of  the  form  u  +  w,  vr  e  R(u),  then  the  elimination  of 
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all  solutions  of  the  form  u  +  w,  v  •  r(u)  is  prescribed  by  Rule  1 
or  2. 

The  validity  of  this  remark  follows  directly  f'-'im  the  definition  of  R(u). 

We  may.  observe  also  that  when  a  solution  u  is  dropped  at  instruction  2 
of  the  algorithm,  it  follows  from  Propositions  2  and  5  that  no  solutions 
of  the  form  u  +w,  w  t  R(u),  will  be  generated  in  S.  Our  next  two  remarks, 
while  less  immediate  than  those  preceding,  are  fundamental  to  the  proof  of 
Proposition  6. 

Remark  6.  Relative  to  a  given  S^,  let  V  be  the  set  of  all  v  c  S 
such  that  there  exist  x  ^  S^,  y  ^  S^,  for  which  v,  x,  and  y  satisfy 
condition  (i)  or  (ii)  in  the  definition  of  R(u).  Then,  if  u  =  v  +  w 
for  some  v  e  V  and  some  w  c  R(v),  it  follows  that  u  e  V.  (Here  u 
and  w  do  not  necessarily  correspond  to  the  u  and  w  in  the  definition 
of  R(u). ) 

Proof,  If  V  satisfies  condition  (i),  then  it  is  immediate  that  u 
does  also  and  hence  u  :  V.  If  v  satisfies  condition  (ii)  for  v  =  y, 
then  u  =  y  +  w,  w  €  R(y),  and  it  follows  from  Remark  5  that  u  e  V. 

Thus,  we  examine  the  case  where  v  satisfies  condition  (ii)  for  v  =  y  +  z, 
z  €  R(y).  Then  from  the  definition  of  u  ve  have  u  =  y  +  z  +  w, 
w  €  R(v).  Making  use  of  the  properties  of  R(u),  by  Remark  h  we 
have  R(v)  =  R(y  +  z)  c  R(y),  hence  w  e  R(y).  But  also  z  €  R(y), 
and  by  Remark  2,  w  +  z  c  R(y).  Finally,  by  Remark  5,  u  €  V. 

Remark  7»  For  V  defined  as  in  Remark  6,  S  -  S  =  V. 

Proof;  It  is  obvious  that  V  c  s  -  S.  To  prove  the  converse,  suppose 
u  ■:  S  -  S  but  u  /  V.  Moreover,  let  u  =  x(h)  be  the  first  solution 


in  S  satisfying  these  two  conditions.  Identify  the  solution  x(i)  ;  S, 
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i  <  h,  such  that  x(i)  +  =  x(h)  and  r  =  d^.  We  observe  by 

Remark  6  (for  x(i)  =  v  and  e^  =  w)  that  x(i)  /  V.  However,  since 
x(h)  is  the  first  solution  in  S  that  is  not  in  V  and  also  not  in 
S,  it  follows  that  x(i)  e  S.  (For  convenience  we  assume  that  the 
indices  of  the  solutions  in  S  are  changed,  if  necessary  so  that 
x(i)  e  S  denotes  the  same  solution  as  x(i)  e  S.  Proposition  5  per¬ 
mits  this  assumption  to  be  made  without  dajiger.)  Since  r  i  d^,  at 
some  point  in  generating  S  we  have  =  i  =  c(h)  =  c(t^) 

+  e^.  Also,  since  x(h)  V,  x(h)  does  not  satisfy  the  criteria  to 
be  dropped  at  instruction  2.  On  the  other  hand,  if  the  algorithm 
generating  S  halts  before  x(h)  is  added  to  S,  then  it  cannot  be  due 
to  T  =  0,  since  t^  must  remain  well-defined  from  the  point  at  which 
x(i)  is  generated  until  ai'ter  x(h)  is  produced.  But  the  method  aiso 
cannot  halt  in  consequence  of  finding  an  optimal  solution  before 
generating  x(h)  since,  otherwise,  by  Proposition  5,  such  an  optimal 
solution  would  have  preceded  x(h)  in  S,  and  thus  S  would  also  have 
ended  before  generating  x(h).  There  are  no  other  ways  that  x(h) 
could  be  prevented  from  belonging  to  S,  and  the  proof  is  completed 
by  contradiction. 

V/ith  the  foregoing  remarks  we  have  established  all  but  one  portion 
of  the  proof  of  Proposition  6,  which  we  now  complete  as  follows. 

Proof  of  Proposition  6.  VJe  claim  that  for  any  z  i  0,  the  lexico¬ 
graphically  largest  u  such  that  u  +  z  is  optimal  is  ahmys  retained 
in  S,  For,  suppose  it  is  not.  We  may  first  observe  that  u  €  S.  This 
is  clearly  true  for  z  /  0  by  Propositions  2  and  4,  and  is  also  true 
for  z  =  0  since  by  Proposition  3,  the  first  optimal  solution  in  S 
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(hence  the  only  optimal  solution  in  S  by  the  rule  for  termination  in 
instruction  3)  is  that  which  is  lexicographically  largest.  Given 
that  u  €  S,  if  u  S  then  u  €  V  by  Remark  7.  Thus  there  exist  x 
and  y  as  in  Remark  6  such  that:  (i)  xDy  and  u  =  y  +  w,  w  i  0;  or 
(ii)  xDy  and  u  =  y  +  w  for  w  c  R(y)  or  w  =  0.  In  both  cases,  y  +  w  +  z 
is  optimal,  and  so  is  x  +  w  +  z.  Thus  cy  =  cx,  and  by  Proposition 
3  X  is  lexicographically  larger  than  y.  But  then  x  +  w  is  legico- 
graphically  larger  than  y  +  w  =  u,  contrary  to  the  definition  of  u. 

It  is  clear  that  Proposition  6  ia5)lies  S*  /  0  when  problem  (3)  hais 
a  finite  optimal  solution.  In  order  to  gain  a  clearer  understanding  of 
our  foregoing  results  it  is  perhaps  worth  pausing  to  consider  not  only 
what  has  been  proved  but  what  has  not  been  proved.  For  exaarple,  if  c  k  0 
but  c  ^  0,  it  is  clear  that  S  might  not  be  finite,  although  a  slight  modi¬ 
fication  in  generating  S  that  allowed  upper  bounds  to  be  taken  into  con¬ 
sideration  would  assure  finiteness  for  an  explicitly  bounded  problem.  On 
the  other  hand,  unless  c  >  0  it  is  easy  to  construct  examples  for  which 
Pi’opositions  3  and  6  are  false.  This  does  not  inmediately  imply  that  S*  = 

0,  but  it  may  actually  make  the  generation  of  S  less  efficient  by  allowing 
a  solution  x  that  is  lexicographically  smaller  than  a  solution  y  to  be 
retained  in  S  while  causing  y  to  be  dropped;  whereas,  had  y  been  generated 
first  (and  yDx),  it  would  have  caused  x  to  drop.  But  the  fact  that  x  is 
lexicographically  smaller  than  y  means  that  it  will  in  general  have  a 
larger  number  of  permissible  continuations,  forcing  the  method  tc  examine 
more  solutions  than  might  otherwise  be  the  case. 

A  more  subtle  point  concerns  the  rule  in  instruction  1  for  breaking 
ties  in  the  determination  of  J,  i.e.,  by  taking  J  at  its  smallest  possible 
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value. ^  It  is:  tempting  to  believe  that  any  rule  for  breaking  ties  might 
do  as  vrell,  but  this  is  false.  (There  is,  of  course,  the  class  of  permis¬ 
sible  tiebrealcing  rules  that  my  be  made  the  same  as  the  one  specified 
by  a  suitable  reindexing  of  the  variables . )  The  choice  of  J  not  only 
affects  the  efficiency  in  the  generation  of  S  (in  the  manner  just  indi¬ 
cated  for  X  >  O),  but  is  crucial  in  determining  whether  an  optimal--or 
even  a  feasible --solution  will  be  found.  It  is  in  fact  possible  to  spec¬ 
ify  choice  rules  for  certain  problems  that  will  cause  S*  to  be  empty  even 
though  an  optimal  solution  exists. 

Having  established  the  validity  of  the  general  framework  of  the 
algorithm  given  above,  \je  vrlU  subsequently  present  a  principal  variation 
of  this  method  in  which  it  is  possible  to  obtain  an  optimal  solution  by 
generating  only  a  subset  of  S.  However,  before  introducing  this  varia¬ 
tion,  and  the  additional  propositions  upon  which  it  is  based,  we  vail 
no\'i  examine  hov7  the  foregoing  method  may  be  applied  in  certain  specific 
situations , 


5.  Applying  the  Method  to  Problem  (2)  VJith  and  VZithout  Additional  Constraints 

VJe  first  consider  solving  problem  (2)  in  the  absence  of  additional 

constraints.  Denoting  the  solution  x(t.)  +  e.  of  instruction  2  by  x,  it 

J  J 

is  clear  that  x(i)Dx  for  x(i)  c  S  (i.e.,  for  i  ^  k  -  l)  if 

c 


y 

I _ t 


)  A.x^  (or  A(t  )  +  A(i)),  since  it  is  assured  by 

Z_i  J  J  J 


The  consequence  of  this  choice  may  be  interpreted  as  a  secondary  cost 
perturbation  that  increments  each  c.  by  c  ./P  -  vfhere,  given  ■that  ain  feasible 

X  satisfy  )  x.  <  D,  P  is  selected  so  that  P  ^  D(kc.)  for  all  j,  where  k  is  a 
L—\  0  0 

multiple  such  that  kc ,  is  an  integer  for  all  j,  and  each  e.  satisfies  0  <  c. 

0  0  0 
<  c.  -I-  c  ./P  and  e.  ,  ^  e./D.  In  conjunction  vfith  the  other  rules  of  the 
0  0  O"'"-^  0 

method,  this  assures  that  c(p)  <  c(q)  for  p  <  q. 
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Propositions  2  and  4  that  c(i)  ^  cx.  Moreover,  x  then  qualifies  to  be 

dropped  by  Rule  1,  since  Pi’opositions  1  and  4  imply  x  S^.  Thus,  to  de- 

termno  vhether  x  may  be  droj)ped  at  instruction  (2)  it  suffices  in  this 

case  to  check  only  vhether  A(t  )  +  A  ^  A(i). 

J  J 

However,  dropping  x  in  this  fashion  eliminates  only  its  permis¬ 
sible  continuations,  v:hercas,  according  to  Rule  1  (and  Proposition  6) 
it  is  legitimate  to  drop  all  the  continuations  of  x.  We  will  no;;  con¬ 
sider  a  v;ay  that  will  permit  this  to  be  accomplished  conveniently  v^hen 

X  has  the  form  ke  . 

s 

Denote  the  value  d^  associated  v;ith  a  solution  x(l)  by  r,  so  that 
denotes  the  first  nonzero  component  of  x(i).  Note  first  of  all  that 
it  is  unnecessary  to  record  any  solution  vector  x(i)  since  x(i)  may  al¬ 
ways  be  reconstructed  by  loiowing  the  group  clement  A(i)  and  the  value 
of  r  (  =  d^)  for  each  i.  Thus  to  determine  x  =  x(i),  \jc  begin  vath  x  =  0, 
and  define  the  next  value  of  x  to  be  ^  =  x  -f-  e^.  Thereupon,  one 
finds  p,  p  <  i,  such  that  A(p)  =  A(i)  -  A^,  and  repeats  the  process, 
treating  3?  as  x  and  A(p)  as  A(i).  As  soon  as  a(0)  i2  reached,  x(i)  is 
completely  determined. 

This  process  may  be  slight3.y  speeded  if  x^  is  knovm  for  each  i. 

Keeping  track  of  this  value,  which  vc  denote  by  U^,  is  particularly 

easy,  since,  in  generating  x(i)  =  x(p)  +  e  \jc  have  U.  =  U  -i-  1  if  d  = 

r  1  p  p 

r  and  Ih  =  1  othcri'risc.  Hovrcvcr,  we  will  cdso  wish  to  luiow  the  value 
of  x^  in  order  to  exploit  Rule  1  more  fully,  in  accordance  v;ith  our 
pr e vi ous  di s  cus  s 1 on . 

Thus,  given  that  x  is  a  solution  that  qualifies  to  be  dropped  from 

S  by  Rule  1,  v/here  exactly  one  component  of  x,  say  x  ,  is  positive,  then 
^  s 

X  ^  X  -  1  may  be  required  of  all  solutions  generated.  This  restriction, 
s  s 
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which  hc'.c  the  forju  x.  SB.,  can  be  accoiitnodatod  in  a  straichtfonfard  \w.y 

c  0 

by  modifying  the  definition  of  the  next  value  t.  of  t  . .  Specifically,  let 

J  d 

t.  =  nrinfl:  i  >  t .  and  d.  5  1).  vzhcrc  d.  =  r  (r  =  d.  )  if  U.  =  B  -  3.,  and 
j  '  j  i  ''  i  '  i'  ir' 

d^  =  r  -  1  if  -  B^, .  (One  my  roecoi'd  d^  at  the  sojne  tine  ar>  recording 
d. ,  or  cinply  flag  d.  to  indicate  whether  d.  =  d.  or  d.  =  d.  -  1.)  This 

•L  3*  •!>  3»  IL  3L 

modified  definition  of  t .  assares  that  one  v/lll  not  generate  any  solution 

0 

^(p)}  ^'(^0  '•  >-(i)  e.,  such  that  >  B..  For  the  value  of  1  S  d.  S  d. 

\  /  jj  ‘^9  ‘^11 

impU-CE  cither  x.  =  0orj=d.  =r  and  x^  S  B.  -  1.  In  either  case, 
d  ^  d  d 

Xj  =  x^  -1-  1  “  .  (Variables  wd.th  0  upper  bounds  are  assumed  dropped 

from  the  problem.)  Also,  the  method  will  not  fail  to  generate  any  solu¬ 
tion  in  v.f’nich  x^  ^  B^,  provided  this  solution  would  have  been,  generated 

under  the  original  definition  of  t^,  since  the  nov?  and  old  definitions 

i  i  T3 

correspond  for  all  1  ^  ^  whenever  x.  ^  B.  -  1  (x.  =  x .  -  l). 

d  d  d  d 

In  direct  extension  of  our  foregoing  remarks,  v;e  next  consider  problem 

(2)  augmented  by  constraints  of  the  form  x.  •>  where  the  B.  do  not  all 

d  d  d 

arise  natiu’ally--i .c . ,  as  a  consequence  of  Rule  l--but  rather  occur  as 

exogenous  restrictions  whicli  may  apply,  for  example,  to  the  x.  that  solve 

d 

problem  (l).  In  this  event,  it  may  no  longer  be  true  that  A(i)  =  A(t.)  +  A. 

d  d 

imp.lics  x(i)Dx  (x  =  x(t  )  +  e  ),  However,  suppose  that,  if  instruction  2 

J  J 

were  temporarily  bypassed,  x  would  be  generated  as  x(q),  and  that  there 
exists  some  x(p)  e  S^,  p  <  q,  such  that  A(p)  =3  A(q).  Then  if  either 
d  <  d  ,  or  if  d  =  d  and  U  >  U  ,  it  follovrs  that  x(p)Dx(q),  and  thus 

q  p7  Q,  p  Q,  /  \  ^/ ? 

X  can  be  da'opped  at  instruction  2  as  a  consequence  of  Rule  2.  Also,  it 
is  evident  tha,t  x(p)Dx,  and  x  can  be  eliminated  by  Rule  1,  if  for  any 
optimal,  solution  of  the  form  x=X'^xgB(i^50  and  B  the  vector  of 
upper  boiuids),  it  follo->’s  that  x(p)  x  d  B,  since  then  x(p)  can  legit¬ 
imately  replace  x  in  such  a  solution.  Me  mention  three  things  that  will 
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assure  this,  in  order  of  increasing  restrictiveness,  but  also  of  increas¬ 
ing  difficulty  of  application:  (i)  =  0  for  those  j  such  that  B.  is 

exogenous,  (ii)  x^  ^  x.  for  such  variables,  (iii)  cx  +  inin(c  .(B.  -  +  l)) 

j  J  J  J  j 

exceeds  an  upper  bound  on  cx,  where  the  minimum  is  computed  over  those  j 

ID  3. 

such  that  B.  is  exogenous  and  x*  >  x..  This  latter  criterion  may  also  be 
J  J  J 

applied  replacing  c  by  e  (the  vector  of  ones)  if  an  upper  bound  on 
is  known. 

If  none  of  the  foregoing  criteria  apply  (other  than  A(p)  =  A(q)),  it 

is  possible  that  x  should  not  be  dropped,  but  retained  as  x(q)  in  S.  In 

this  event  one  may,  if  desired,  cut  dc^/n  the  number  of  solutions  examined 

by  not  alJoifing  the  consideration  of  any  solution  x(q)  +  e .  such  that 

J 

O 

0  <  d  .  An  additional  index,  m  ,  assigned  to  x(q)  (generally,  m. 

assigned  to  x(i))  will  accomplish  this  if  one  defines  t ,  so  that 

J 

t.  =  min(i:  1  >  t.,  m.  S  j  ^  )»  where,  in  this  case,  m  =  d  -  1.  The 

introduction  of  m^  and  d^  in  the  revised  definition  of  t^  has  precisely 
the  effect  of  restricting  the  set  H(x(i))  from  which  the  permissible  con¬ 
tinuations  of  x(i)  with  respect  to  are  determined. 

The  foregoing  remarks,  ho\;ever,  do  not  take  advantage  of  the  fact 
that  the  A(i)  are  elements  of  a  finite  group.  This  is  an  important  con¬ 
sideration,  and  we  will  sho\7  ho\-r  to  exploit  its  implications  later.  For 
the  moment,  hov^ever,  we  continue  to  evolve  the  structure  of  the  algorithm 


To  prove  this  suppose  u  =  x  z  is  optimal  for  some  z  2  0.  Then 

cu  2  o:  +  c  .z  .  for  all  j.  How,  x(p)  +  z  will  be  optimal  unless,  for 
J  J 

some  J  such  that  B.  is  exogenous,  z.  +  x^  2  B.  +1.  But  then  x^  >  x., 
z^  2  Bj  -  x^  +  1,  and  hence  cu  2  cx  +  min(c^.(B^  -  x^  +  l)).  V/hen  this 
cannot  be  satisfied,  as  stipulated  in  (iii),  then  x(p)Dx  is  assured. 

2 

Some  or  all  of  those  solutions  for  j  =  d  may  also  be  eliminated,  the 
details  of  \7hich  depend  on  the  value  of  U  ,  ^  and  may  be  readily  developed 
from  the  considerations  discussed  here.  ^ 
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to  ac commode, tc  other  kindc  of  restrictions. 


It  is  rather  transparent  that  a  restriction  of  the  form  2^  ^  M 


M  +  1  where 
P 


may  be  handled  simply  by  recording  M.  =)  --  i.e.,  M.  = 

1  /  I  «3  1 

x(i)  =  :^(p)  +  e..  for  some  j.  Then  i.^hon  M.  =  M,  it  is  desired  that  R(x(i)) 
0,  wliich  may  readily  be  assui'ed  by  setting  d^  =  0. 

One  criterion  for  dropping  solutions  at  instruction  2  is  immediate. 

If  x(p)Dx  or  x(p)Dx  in  the  absence  of  the  constraint  ^  x^.  ^  II,  then  i 


X.  (  =  M,  -I-  l)  assures  that  the  same  relation  will  hold  in  the  present 

'  V-  - 

instance.  On  the  other  hand,  if  >  y  x^,  then  x  may  have  to  be  retained 

as  x(q).  An  exception  occurs  when  cx  +  (M  +  1  -  M  )(Hin(c.))  exceeds  an 

P  J 

upper  bound  on  cx,  by  reasoning  similar  to  that  of  footnote  1  on  the  pre¬ 
ceding  page.  It  may  be  noted  that  this  criterion  may  be  checked  quite 
easily.  The  criterion  may  also  be  sharpened,  though  at  some  computational 

expense,  by  Indexing  the  c.  in  ascending  order  of  magnitude  and  defining 

J 


k  to  be  the  least  index  such  that 


B .  >  M  +  1  -  M  .  One  then  tests 
J  P 


whether  M,  given  by  M  =  cx  + 


)  B.c.  +  (M+1  -  M  -  )  B.)c,  ,  exceeds 

/  ,  J  J  V  0 


j<k  j<k 

the  bound  on  cx.  Moreover,  if  criterion  (iii)  on  page  22  holds,  then 

z.  5  B.  -  x?  (see  the  associated  footnote),  and  one  may  replace  B.  in  M 
.1  0  J  J 

by  B.  =  B.  -  x^,  redefining  k  in  terras  of  the  B.  instead  of  the  B..  We 

J  J  J  J  u 

give  attention  to  such  criteria  because,  in  the  form  of  the  algorithm 
introduced  in  the  next  section,  upper  bounds  on  cx  are  likely  to  be 
obtained  before  determining  an  optimal  solution. 

Now  consider  a  restriction  of  a  somewhat  different  sort.  Suppose  that 
the  problem  ^rariables  are  divided  into  a  number  of  different  sets  such 

that  at  most  one  variable  in  any  particular  set  may  assume  a  positive  value. 
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A  fsuniliax  example  of  such  a  restriction  is  given  by  a  set  of  constraints 

of  the  form  )  x .  ^  1 . 

0  e 

One  method  of  accommodating  such  a  restriction  is  as  follows.  Assign 

a  different  prime  number  to  each  set  Q^,  and  assign  to  the  variable  the 

set  of  prime  numbers  corresponding  to  those  to  which  j  belongs .  If  the 

Q,  are  disjoint,  x.  will  thus  be  assigned  at  most  one  prime  number.  Then, 
n  j 

to  each  A(i)  generated  by  the  method  we  attach  a  number  P^.  We  let  =  1, 
and  determine  P  ,  where  x(q)  =  x(p)  +  e.,  so  that  P  =  P  G.,  where  G,  is 

q  0  q  p  J*  j 

the  product  of  those  primes  associated  with  x..  We  do  not  allow  x(q)  to 

J 

be  created,  however,  if  any  prime  associated  with  x^  divides  P^.  It  is 

easy  to  see  that  this  approach  v;ill  cause  the  method  to  generate  only 

those  solutions  satisfying  the  indicated  restrictions .  Also,  the  largest 

P^  will  not  exceed  the  product  of  the  primes  attached  to  the  Q^,  and  may 

be  substantially  less  than  this  product.^ 

Another  (perhaps  better)  way  of  handling  such  restrictions  is  to 

assign  the  numbers  1,  2  ,  4,  10  ,  20,  40,  100,  200,  400,  etc.,  one-to-one 

to  the  sets  Q^,  and  to  assign  each  x^,  as  before  the  numbers  attached  to 

those  0^  for  which  j  *  Q^.  In  this  case  we  let  P^  =  0,  and  let  P^  =  P^  +  G^, 

where  x(q)  =  x(p)  +  e.  and  G.  is  the  sum  of  the  numbers  associated  with 

J  J 

X . .  It  is  not  hard  to  see  how  to  determine  whether  it  is  permissible  to 
J 

generate  the  solution  x(p)  +  e.  when  using  this  scheme.  Also,  a  quite 

J 


The  manner  of  assigning  primes  to  the  will  significantly  influence 

the  size  of  the  largest  P^.  A  step  in  the  right  direction  would  be,  for 

example,  to  assign  the  smallest  primes  to  those  with  the  largest  number 

of  elements.  It  would  also  be  possible  to  use  -1  for  the  "first  prime," 
followed  by  2,  3j  etc. 
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Icirgc  numbei'  of  sets  may  be  accommodated  by  rcprcGenting  a  large 

o  2 

by  more  than  a  single  number,  e.g.,  by  It,  P^,  P^  whore  P^  is  the 
"aug^nented  number"  (p^,  P^,  P°). 

The  ability  to  drop  solutions  at  instruction  2  is  rather  limited 
v/hen  accorariiodating  restrictions  such  as  the  one  above  unless  one  is  will¬ 
ing  to  apply  more  involved  tests  for  determining  x(p)Dx  and  x(p)Dx.  How¬ 
ever,  if  the  X.  are  not  subject  to  other  types  of  restrictions,  then  one 
criterion  that  assui'es  x(p)Dx(q)  (representing  x  as  x(q))  is  A(p)  a  A(q) 

whenever  P  divides  P  and  the  P.  are  determined  by  the  prime  number 
p  q  1 

assignment . 

6 .  A  Variation  of  the  Algorithm 

VJe  now  indicate  a  refinement  of  the  method  that  in  some  cases  will 
make  it  possible  to  substantia]  uy  reduce  the  number  of  solutions  generated. 
First,  suppose  that  we  wish  to  solve  problem  (2)  in  the  absence  of  addi¬ 
tional  restrictions,  and  assume  that  a  list  g^,  g^,  ...,  g^^  is  associated 
with  the  D  elements  (including  O)  of  the  additive  group,  where  g^^  =  i 
if  A(i)  is  the  kth  group  element  and  g^^  =  0  if  the  kth  group  element  has 
not  yet  been  generated.  Such  a  list  v/ould  evidently  be  useful  in  the 
ordinary  procedure  of  determining  v/hen  a  solution  is  to  be  dropped  at 
ins  truction  2.  However,  note  that  if  A(p)  and  A(q)  are  generated  such 
that  A(p)  +  A(q)  =  A^,  then  x(p)  +  x(q)  is  a  feasible  solution  to  problem 
(2).  Moreover,  if  x*  is  an  optimal  solution  to  (2)  such  that  either  x*  - 
x(p)  i:  0  or  x*  -  x(q)  0,  then  it  can  readily  be  shown  that  x(p)  +  x(q) 
is  an  optimal  solution  to  (2).  Consequently,  A(p)  +  A(q)  =  allows  us  to 
limit  the  A(i)  generated  in  two  ways.  First,  wo  need  not  generate  any  con¬ 
tinuations  of  A(p)  or  A(q)  (which  potentially  eliminates  2n  sequence  terms. 
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although  usually  many  of  these  will  already  be  removed  from  consideration), 

and,  second,  the  solution  sequence  may  be  termin'- ted  as  soon  as  c(i)  ^ 

c(p)  +  c(q).  This  knowledge  can  be  exploited  with  the  use  of  the  g^^  list 

as  follows.  When  any  A(q)  is  generated,  check  the  value  g,  ,  where  A  - 

A(q)  is  the  element  of  the  additive  group.  If  gj^  =  0,  then  nothing 

is  to  be  done,  but  if  g,  =  p  >  0,  then  A(p)  +  A(q)  =  A  .  Thus  set  d  = 

ic  op 

dg^  =  0,  so  that  no  permissible  continuation  of  x(p)  or  x(q)  will  be  gen¬ 
erated.  In  addition,  if  any  continuation  x(i)  of  x(p)  (permissible  or 
otherwise)  has  already  been  generated,  we  may  set  d^  =  0.  The  fact  that 
x(p)  +  x(q)  is  a  solution  to  (2)  is  recorded,  unless  some  better  feasible 
solution  has  already  been  found.  Note  that,  although  no  continuation  of 
certain  of  the  sequence  terms  need  be  generated,  these  terms  may  still  be 
used  to  drop  other  sequence  terms  in  the  usual  fashion  at  instruction  2. 

The  best  feasible  solution  found  supplies  the  value  cx*  such  that  the 
sequence  generation  stops  when  c(i)  ^  cx*.  (The  process  may  also  stop 
siniply  because  T  becomes  empty.) 

But  we  can  generally  do  still  better  than  this,  extending  the  fore¬ 
going  remarks  to  problem  (3)  in  the  process. 

For  each  x(k)  e  S  ,  let  F,  be  the  set  of  those  x(i)  e  S  ,  i  ^  k, 

c  x  c 

such  that  x(i)  +  x(k)  is  feasible  for  problem  (3),  and  if  Fj^  /  0,  let 
x(v)  be  the  particular  element  of  F^^  such  that  v  =  min(i:  x(i)  e 

^  If  one  is  solving  problem  (2)  subject  to  additional  constraints,  a 
modification  of  the  g^^  list  can  be  conveniently  used  to  identify  Fj^  and 

x(v).  For  this  purpose,  instead  of  assigning  a  single  component  g,  to 

ic 

the  kth  group  element,  one  may  define  gj^^  to  be  the  index  of  the  first 
A(i)  equivalent  to  the  k;^  group  element,  gj^  to  be  the  index  of  the 
second,  and  so  on. 


Then,  bcivccn  instructions  3  and  k  of  the  method  vre  my  insert  the 
instruction: 

3-^.  If  F.  =  0,  £0  to  instruction  4.  Othendsc,  set  d,  =  0  for 

ll  '  K 

all  x(i)  G  F,  ,  for  i  =  k,  and  for  each  x(i)  g  S  that  is  a  con- 

K  C 

tinuation  of  some  solution  in  Fj^.  If  c(k)  +  c(v)  <  c:c>5-,  v;here  x* 

denotes  the  best  feasible  solution  previously  found,  designate  x(k) 

+  x(v)  to  be  x:^. 

When  the  method  is  augraented  by  instruction  3A,  the  condition  T  =  0 
of  course  my  not  indicate  the  absence  of  a  feasible  solution,  but  only 
that  no  solution  exists  that  improves  upon  x*,  provided  x->^  is  well- 
defined. 

Proposition  6  assui'cs  that  for  each  x(k)  g  S  there  is  an  x(i)  g  S 
such  that  x(k)  -i-  x(i)  is  optimal  if  an  optimal  continua,tion  of  x(k) 
exists.  But  then,  because  the  c(i)  arc  monotonically  nondecreasing, 
the  first  x(i)  such  that  x(i)  +  x(k)  is  feasible  must  be  optimal.  The 
Justification  of  3A  foUen/s  immediately,  and  the  algorithm  may  clearly 
be  halted  at  instruction  2  as  soon  as  Wj  ^  cx*.  Vie  now  state  an  im¬ 
portant  condition  that  allo\'rs  the  algorithm  to  be  halted  still  earlier. 
Proposition  7.  V/hen  the  method  of  Section  3  is  augmented  by 
instruction  3^,  then  the  algorithm  may  be  halted  at  instruction  2, 
and  the  best  feasible  solution  x-^  found  taJ^en  as  optimal,  v^henever 
Nj  -  c(h)  >  c^j,  where  c^^  =  Max(c^)  and  c(h)  =  miix(c(i):  c(i)  <  cx-x-  -Nj). 
(Until  a  feasible  solution  is  found,  let  c(h)  =  co. ) 

Note :  Proposition  7  may  be  interpreted  as  follows.  Suppose  a 
feasible  solution  x^‘  has  been  found  by  the  method  with  instruction 
3A.  included.  Until  such  a  solution  is  found,  the  m.ethcxl  is  the 
same  as  before.  Ho\7ever,  the  next  solution  x(r)  to  be  generated. 
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and  all  remaining  ones,  must  satisfy  c(r)  S  Nj  for  the  successive 
current  values  of  N,..  No;/,  if  x*  is  not  optimal,  and  if  there  is 

U 

any  solution  x(h)  such  that  x(h)  +  x(r)  is  optimal,  then  c(h) 
cannot  exceed  the  value  assigned  to  it  by  Proposition  7*  Also, 
by  thus  assigning  c(h)  its  iiiaximiun  possible  value  and  c(r)  its 
minimum  possible  value  N^.,  one  minimizes  c(r)  -  c(h)  for  all  r 
and  h  such  that  c(r)  -f-  c(h)  <  cx*,  c(r)  ^  c(h).  The  proposition 
then  asserts  (through  the  relation  Nj  -  c(h)  >  c^j)  that  once  this 
minlm'jm  difference  exceeds  Cj^^,  a,n  optimal  solution  has  already 
been  found. 

V/e  break  the  proof  of  Proposition  7  into  several  parts,  as  follov/s. 
Remark  8.  Let  x  and  x  be  chosen  so  that  they  minimize  cy.  -  cP. 
subject  to  ex  -  cSi  ^  0,  x,  5!;  >  0,  and  x  +  x  is  an  optimal  solution  to 

problem  (3).  Then  cx  -  c^  S  c^^. 

Proof.  Suppose  the  conclusion  is  false.  Select  any  j  such  that 

X.  >  0  and  let  x.'  =  x .  -  1,  x."  =  Si .  +  1,  with  the  renainlng  com- 

0  0  0  d  0 

ponents  of  x'  and  x"  equal  respectively  to  the  corresponding 

components  of  x  and  $i.  \lc  must  have  ex’  -  cx"  <  0  since  cx’  -  ex"  = 

cx  -  cP  -  2c.,  and  x  and  x  arc  assumed  to  minimize  cx  -  cx  k  0.  But 
J 

then,  from  cx  -  c5c  >  c„  v;c  obtain  cx”  -  ex'  <  2c .  -  a,  c.,,  vhere 

M  0  H  Ir 

x"  and  x'  satisfy  the  requirements  for  x  and  P,  contrai'y  to  assumption. 

Rcmarl;  9-  Let  q  be  the  least  index  such  that  x(q)  e  S  and  for  some 
p  S  q,  x(q)  -t-  x(p)  is  optima?  (x(p)  e  S).  Then  c(q)  -  c(p)  = 
cx  -  c^  for  X  and  x  chosen  as  in  Remark  8  and  for  all  p,  p  ^  q> 
such  that  x(p)  -f-  x(q)  is  optimal. 

li^oof.  Suppose  that  for  q  and  for  some  p  as  given,  ve  have  cx  -  cx 
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<  c(q)  -  c(p).  Then  from  cx  +  c$  =  c(q)  +  c(p)  we  obtain  cx  <  c(q). 
By  Proposition  6  there  is  a  solution  x(s)  c  S  such  that  x(s)  +  S  is 
optiml,  and  also,  therefore,  a  solution  x(r)  e  S  such  that  x(r)  + 
x(s)  is  optimal.  It  is  immediate  that  c(s)  =  cx  and  c(r)  =  cSt. 

But  then  c(r)  ^  c(s)  <  c(q),  implying  r,  s  <  q,  which  is  impossible. 

Proof  of  Proposition  7«  Let  S'  denote  the  sequence  generated  \rtien 
the  method  is  augmented  by  instruction  3A.  It  may  readily  be  veri¬ 
fied  that  the  proofs  of  Propositions  1,  2,  3  and  5  apply  to  S* 
as  well  as  to  S,  since  these  proofs  do  not  depend  upon  the  legiti¬ 
macy  of  eliminating  continuat:  ons  of  solutions  in  from  S . 

(Only  Proposition  6  depends  upon  such  legitimacy.)  Likewise,  one 
may  conclude  from  the  reasoning  of  Proposition  5  that  S*  is  a 
subsequence  of  S.  Consequently,  we  may  assume  that  the  indices 
of  solutions  in  S'  are  assigned  so  that  x(i)  c  S' and  x(i)  e  S 
denote  the  same  solution.  Then  let  q  be  selected  as  in  Remark  9» 
and  given  this  value  of  q,  let  p  assume  the  smallest  value  (p  ^  q) 
such  that  x(q)  +  x(p)  is  optimal.  We  now  wish  to  establish  that 
x(p)  and  x(q)  belong  to  S'.  If  not,  one  or  the  other  of  them  must 
be  excluded  from  S'  as  a  consequence  of  instruction  3A.^and  thus 
may  be  expressed  in  the  form  x(i)  +  z  or  x(k)  +  z,  where  x(i)  +  x(k) 
was  discovered  to  be  feasible,  x(i)  €  Fj^,  and  z  ^  0.  Since  k  S  q  is 
required  if  x(p)  or  x(q)  is  to  be  eliminated  as  a  consequence  of 
finding  the  feasible  solution  x(i)  +  x(k),  we  have  c(k)  S  c(q). 

Then  from  c(k)  +  c(i)  h  c(q)  +  c(p)  we  also  have  c(p)  2  c(i),  and 
hence  c(k)  -  c(i)  -  c(q)  -  c(p).  If  this  last  holds  as  an  equality, 
then  c(k)  =  c(q)  and  c(p)  =  c(i),  from  which  it  follows  by  the  defini¬ 
tion  of  q  that  k  =  q,  and  x(q)  e  S'.  (x(k)  and  x(i)  are  not  dropped 


from  S’,  but  only  their  continuations  not  in  S’.  Of  coiu'se,  one  may 
alternately,  if  desired,  thiidc  of  x(k)  and  x(i)  as  bcinc  dropped 
also.)  But  then,  also  p  5  i,  hence  x(p)  cannot  have  been  eliminated 
from  S’.  In  pai'ticular,  p  =  v  for  v  as  defined  for  instruction  3A., 
and  hence  the  solution  x(p)  +  x(q)  v/ould  have  been  chosen  as  x*  by 
the  method.  Thus,  ve  examine  the  case  for  c(k)  -  c(i)  <  c(q)  -  c(p). 
By  Remark  9  it  follovfs  that  c(k)  +  c(i)  >  c(q)  -i-  c(p).  Therefore 
c(p)  <  c(i),  p  <  i,  and  x(p)  camiot  have  been  eliminated  from  S'. 
Thus,  if  x(q)  ^  S',  or  if  x(q)  +  x(p)  v:as  not  selected  as  x*,  we 
must  have  q  >  k  and  either  x(q)  =  x(k)  +  z  or  x(q)  =  x(i)  +  z. 
Suppose  x(q)  =  x(k)  +  z.  Then  from  c(q)  +  c(p)  <  c(i)  +  c(k)  ve 
obtain  cz  +  c(p)  <  c(i).  Since  x(k)  +  z  -i-  x(p)  is  oi^timal,  by 
Pi'oposition  6  there  is  a  solution  x(r)  e  S'  such  that  x(k)  +  x(r) 
is  optiml,  c(r)  <  c(i).  But  this  is  incompatible  vith  q>  k.  One 
similarly  obtains  a  contrr.diction  from  the  assumption  x(q)  =  x(i) 

+  z,  which  completes  the  proof,  for  we  have  sho\m  both  that  x(p), 
x(q)  c  S’  and  that  x(q)  +  x(p)  was  at  some  point  selected  as  x*. 


To  cet  an  idea  of  the  restrictiveness  of  the  tcrminatin[i  condition 
of  Proposition  7^  ve  note  that  it  allm^s  the  algoritlmi  to  stop  whenever 
Nj  cx-'^P  +  Cjj  (where  cx>!-  is  the  optimal  objective  fiuiction  value),  and 
generally  sooner.  This  is  likely  to  result  in  considerable  computational 
savings  in  the  event  that  it  is  not  difficult  to  check  for  feasibility 
and  Cj  is  somewhat  smaller  than  c::-x-/2.  (Savings  v^oidd  likely  result  in 
an^'’  case  due  to  the  continuations  that  arc  di'oppcd.)  The  reason  for  this 
lies  in  the  fact  that  there  are  generally  many  more  distinct  solutions 
X  that  yield  ti)e  scu.ic  vri-luc  of  cx  for  ex  D.argc  than  for  cx  si.iall.  For 


example,  if  the  objective  is  to  minii.iiz.e 


X.  and  if  cx-x-  =  20,  it  is 


4 
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evident  that  the  number  of  solutions  z  that  satisfy  OS  S  11  is 


considerably  smaller  than  those  that  satisfy  12 


S  y  X.  S  20. 


course,  the  method  would  ordinarily  generate  only  a  small  fraction  of 
the  latter  range  of  solutions  in  any  event.  But  the  existence  of  a  cut¬ 


off  point  at 


I*. 


<  12  would  likely  allo\-;  a  further  elimination  of 


possibilities . 


The  question  arises  as  to  whether  it  is  possible  to  shortcut  the 
generation  of  solutions  if  it  is  lcno\m  beforehand,  or  explicitly  required, 
that  an  optimal  solution  must  satisfy  a  constraint  of  the  form^x^  2  L. 

VJe  s^^i»hat  this  question  may  be  answered  affirmatively  in  the  next 
section. 

7.  Accommodating^Xj  =  ^  L,  and  related  constraints. 

We  have  already  seen  how  to  handle  constraints  of  the  form  Y* * j  ^  M. 
The  method  for  handling  constraints  of  the  form  ^  x^  =  L  and 

y x^.  2  L  is  quite  similar.  Suppose  tliat  =  Min  (Cj).  To  accommo¬ 
date  y Xj  =  L,  x^  is  eliminated  from  the  objective  function  by  pivot 

reduction  (i.e.,  by  replacing  x  by  L  -  y  x.),  so  that  the  nei7  objective 

jS2 

function  coefficient  for  each  j  is  c . '  =  c .  -  c^  2  0.  (if  c.*  =  0  for 

a  J  1  J 

some  j  /  1,  then  the  problem  is  of  course  perturbed  so  that  c.'  >  0.) 

With  X-  thus  "eliminated,"  onl^'-  the  variables  x,  for  j  ^  2  enter 
explicitly  into  consideration,  and  >  x^.  =  L  \rith  x^  S  0  is  accomodated 
by  requiring  ^Xj  S  L. 


The  constraint 


y^x,  jLi 


s  handled  in  a  like  fashion,  introducing 


the  nonnegative  integer  slack  s^^  and  vrriting  y  x.  -  s^  =  L. 


After 


remo'/ing  x^  from  the  objective  function  as  above,  and  treating  it  as 
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dependent  variable  (s^  nw  has  the  objective  function  coefficient  c^^), 
we  are  left  with  the  inequality  )  S  L.  To  assure  that  the  method 

will  actually  generate  only  those  solutions  satisfying  y  x.  i  L,  it  is 
important  that  be  indexed  as  the  last  x  variable;  i.e.,  s^  = 

As  a  consequence,  whenever 


n 

Vx^ 
z.  J 

j=2 


x^^^  =  L,  no  permissible  continuation 


of  x(i)  may  be  allowed,  since  every  permissible  continuation  of  this  solu- 

— I 

tion  would  necessarily  violate  /  x.  -  S  L.  Note  that  this  would 

j=2 

not  be  the  case  if  s^  were  not  the  last  x  variable . 

Variations  immediately  suggest  themselves.  Whenever  the  problem  has 
a  subset  of  constraints  of  the  form  )  a. .x.  ^  a.  ,  where,  say,  a. .  i  0 

Z.  iJ  J  lo’  *  x;} 

for  j  =  1,  ...,  r.  and  a.  .  ^  0  for  j  =  r.  +1,  ...,  n,  then  it  can  readily 

1  1 1 

be  seen  how  to  apply  the  algorithm  so  that  every  x(i)  generated  satisfies 
all  such  constraints  for  which  a.  ^  0.^  In  accordance  vrith  these  remarks, 
it  would  be  reasonable  to  attempt  to  impose  an  indexing  of  variables  that 
would  create  this  structure,  or  nearly  this  structure,  for  several  of  the 
problem  constraints .  For  constraints  that  could  not  be  put  in  this  form 
(given  that  other  constraints  do  have  the  desired  form),  it  would  be  use¬ 
ful  to  index  as  many  positive  a^^  as  possible  ahead  of  the  first  negative 


ij 


^  Similarly,  for  constraints  of  the  form  a^x^  =  a^  (mod  l),  where  the 


a.  may  represent  either  scalars  or  column  vectors,  if  the  a.  for  j  =  1, 

J  J 

are  contained  in  a  subgroup  of  the  group  ^nerated  by  the  a^  (mod  l)  for  all 

j  (e.g.,  a.  =  0  for  j  ^  r),  then  if  a  -  )  a.x^  is  not  a  member  of  the  sub  - 

’  o/Ljj 

group,  the  continuations  x(i)  +  e.  for  j  ^  r  need  not  be  generated.  To 

J 

exploit  this  and  Gimilar  relations  more  thoroughly,  it  is  of  course  pos- 

sible  to  reindex  the  x.  for  the  permissible  continuations  of  x(i).  However, 

3 

such  local  reindexing  requires  more  memory,  and  does  not  permit  a  solution 
x(i)  to  b^  dre^ped  unless  R*(x(i))  =  or  unless  ir*‘(x(i))  /  P  can  be  shown 
to  imply  i^(xCp))  Z  P  solution  x(p)  not  dropped. 
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8,  Passive  Variables  and  Additional  Ways  of  Handling  Upper  Bounds  for 
Problem  2. 

We  will  be  concerned  in  this  section  with  two  additional  ways  of 
handling  certain  types  of  problem  constraints  that  arise  chiefly  in 
the  context  of  problem  (2).  The  first  way  involves  the  creation  of 
"passive"  variables  to  restrict  the  number  of  solutions  generated.  The 
second  involves  a  means  for  determining  when  some  subset  of  exogenous 
bounds  is  actually  nonbinding,  thus  allowing  the  bounds  to  be  treated 
as  natural.  To  accomplish  the  second  goal  we  will  subsequently  derive 
some  needed  results  about  finite  additive  groups. 

Suppose  first  that  x.  ^  B.  is  required  for  all  x,,  and  that  there 

J  <3  0 

exist  nonnegative  integers  h,  k  (h  >  0)  such  that  kc^  §  hc^,  kA^^  *  hAg. 
Ordinarily,  if  ke^  is  generated  as  x(p)  and  he^  is  generated  as  x(q),  q 
>  p,  it  would  not  be  permissible  to  drop  x(q)  due  to  the  existence  of 
the  exogenous  However,  note  that  ve  may  require  of  any  optimal 

solution  that  x^  ^  h  only  if  ^  ^  (equivalently,  x^  5  B^  -  k 

only  if  Xg  ^  h  -  l).  For  if  x^  ^  h  and  ~  ®l  "  obtain  a 

solution  with  no  greater  value  of  cx  by  decrementing  x^  by  h  and 
incrementing  x^^  by  k.  To  take  advantage  of  this  fact  we  create  the 
"passive"  variable  ^2,  2  ~  ^2  ^  -  k  +  l)x^.  We  call  x^  ^  passive 

because  when  x^  _  is  generated  as  a  solution  x(i),^  we  remove  x  _ 
from  the  list  of  variables,  and  assign  a  large  enough  value  to  so 
that  all  original  variables  may  combine  with  x(i)  to  form  other  solu¬ 
tions.  In  doing  this,  we  restrict  x^  so  that  x^  ^  h  -  1,  except  for 


^  By  the  obvious  convention,  we  mean  by  this  that  -  K  +  1, 

Xp  =  h,  and  x^  =  0  for  J  ^  3. 

C-  J 
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the  continuations  of  x(i).^ 

There  are  other,  more  general,  instances  in  which  the  creation  of 
passive  variables  may  be  useful.  V.’e  v/ill  not  attempt  to  give  a  fornxal 
description  of  these,  but  instead  provide  some  examples  from  which  the 
general  procedures  may  be  inferred.  Suppose,  for  example,  that  by  a 
relationship  such  as  outlined  above,  or  by  some  other  means,  it  is  known 
that  Xg  ^  5  implies  x^  ^  3  end  that  x^  ^  7  implies  x^  ^  6.  To  handle 
this  we  may  create  the  passive  variables  ^  “  3Xj^  +  5^^  and  2  3  ~ 
3x^  +  6x2  +  7^2 *  impose  the  restrictions  x^  ^  4,  x^  ^  6,  except 

that  Xg  ^  1  when  combines  with  x^^  and  x^  ^  -  6,  x^  ^  -  7 

when  variables  combine  v;ith  x  _  If,  in  addition  to  the  foregoing, 

Xi^  ^  5  ini>lies  x^  ^  2,  we  create  the  faro  additional  passive  variables 

x^  =  2x.^  +  5x^  and  2  3  4  ~  ^1  2  3  ^^4'  vrhich  such 

passive  variables  may  be  created  to  accommodate  other  similar  situa- 

2 

tions  should  by  novr  be  clear. 


Note  that  vre  could  alternately  let  x  =  (B  -  k  +  l)x  (hence 

j,  1)*^  1  1 

Xj^  =  Bj^  -  k  +  1,  Xj  =  0  for  J  ^2)  and  then  require  x^  g  B^  -  k  and  x^ 

^  h  -  1  except  for  continuations  of  x(i). 

2 

Passive  variables  provide  a  base  upon  which  the  rules  of  the  algo¬ 
rithm  generate  a  partitioning  of  the  x(i).  The  justification  for  the 
partitioning  may  be  expressed  in  terms  of  logical  equivalences;  e.g.,  in 
a  simple  case:  (P  -rQ)  <-  -  >>  (P  A  Q)  v  (~  P).  An  interesting  special 
use  of  the  passive  variables  occurs  when  the  logical  alternatives  provide 
lo\-7er  boLuids  on  cx,  vrhich  may  then  be  evaluated  in  place  of  N.  for  such 

t) 

variables.  Passive  variables  may  also,  of  course,  be  created  at  later 
stages  of  the  solution  process.  Thus,  if  it  is  determined  that  the  per¬ 
missible  continuations  of  x(i)  must  satisfy  x.  ^  L.,  vrhere  L.  >  x^  for 

«)  J  i)  J 

some  subset  R  of  the  j  ^  d^,  then  one  may  take  advantage  of  this  by 

creating  x  ,  say,  vrhere  generating  x  as  a  solution  x(p)  gives  x^  =  L. 

a  p  i  u  0  0 

for  j  6  R  and  x^  =  x.  othendse.  In  this  case,  d  is  set  equal  to  d. , 

0  0  p  1 

and  x(i)  may  bo  disregarded  as  a  source  of  continuations. 
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We  ncrw  turn  to  the  second  means  of  handling  upper  bound  restric¬ 
tions  .  It  may  well  happen  that  certain  exogenous  B .  do  not  in  reality 
exert  ajiy  influence  upon  the  set  of  optimal  solutions  to  (2).  We  derive 
some  results  concerning  additive  groups  that  will  help  to  determine  when 
this  is  the  case. 

Imagine,  in  particular,  that  one  has  found  k,  h  such  that  hc^^  S  kCg 
and  hA^  =  kA2.  Under  some  circumstances,  it  is  possible  to  impose  the 
restriction  x^  S  k  -  1,  using  k  -  1  as  a  natural  bound  for  x^,  in  spite 

of  the  fact  that  x^^  5  for  B^  exogenous.  We  develop  one  such  circum¬ 

stance  as  follows. 

Proposition  8.  Assume  z  e  G  if  and  only  if  z  =  ^A  .x B .  ^  x .  SO, 

and  x^  integer.  Let  ^2^1  -  ^2^2’  ^  ^2 

+  1  ^  h^,  B2  +  1  ^  k^  (h^,h2,k^,k2  nonnegative  integer).  Then 

(i)  k^h2  >  k2h^  implies 

(ii)  z  6  G  if  and  only  if  z  =^AjX^,  x^  integer,  B^  S  x^  SO  for 

j  S  3  and  h2  -  1  ^  x^  S  0,  k^^  -  1  ^  X2  ^  0. 


Proof.  Assume  z 


=  )  A.X.,  X,  integer,  B.  S  x.  SO  but  x_  S  k.  or 


^  h^.  If  X2  S  kj^,  let  x^’  =  X >^2'  “  ^2  "  “ 

x.&r  j  S  3*  Then  we  have  z  =  y  A.x.’.  Consider  the  linear 
function  L(x)  =  k2X^  +  h2X2.  By  (i)  it  follows  that  L(x')  <  L(x). 

V/e  replace  x’  by  x  and  repeat  the  process  with  L(x)  strictly  decreas¬ 
ing  at  each  step,  until  X2  ^  k^  -  1*  Uow  possibly  x^  S  h2  (or  pos¬ 
sibly  ^2  ^  ^1  “  ^2  ^®6in  with).  Define  -  ^2* 

^2*  “  ^2  ^  ^2’  ~  J  ^  3,  so  that,  again  z 

In  this  case  L(x')  S  L(x).  Denoting  x'  by  x  and  repeating,  eventually 
x^  ^  h2  -  1.  If  now  X2  S  k^,  the  original  replacement  process  is 
initiated.  Continuing  this  cycle  of  replacing  x  by  x'  vre  see  that 
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L(x)  is  always  nonincreasing  and  is  periodically  strictly  decreasing. 
From  (i)  it  follows  that  h2  >  0  and  thus  (ii)  is  true  or  else  even¬ 
tually  <  0.  But  the  latter  is  impossible  by  the  way  in  which  x* 
is  defined  in  terms  of  x. 


To  see  specifically  how  Proposition  8  relates  to  the  problem  of  de¬ 
termining  natural  bounds,  suppose  that  no  exogenous  bounds  B.  existed 
and  that  h^e^^  was  generated  as  a  solution  x(p).  Then,  if  subsequently 
the  solution  was  considered  for  inclusion  among  the  x(i),  where 

=  ^j^A^  (as  in  Proposition  8),  the  fact  that  S  ^2^2  permit 

the  solution  k^e^  to  be  dropped  and  the  restriction  x^  ^  k^  -  1  to  be 
in5)osed.  Likewise,  the  method  would  similarly  permit  x^  ^  h^  -1  to  be 
imposed  if  were  generated  as  x(p)  and  k^A^  =  ^*^^2  “  ^2*^1’ 

Observe  now  that  h^c^  ^  k^c^  and  k^c^  ^  h^c^  imply  k^h^  ^  k^h^. 

This  follOTiTS  by  multiplying  the  first  inequality  by  h^,  the  second  by  h^, 
combining,  and  then  dividing  through  by  c^  >  0.  But  by  Proposition  8,  if 
in  fact  k^h^  <  k^h^,  then  imposing  x^  ^  h^  -  1  and  x^  ^  k^^  -  1  will 


be 


permissible  even  if  x.  ^  B.  for  exogenous  B.  (provided  the  new  bounds 

J  <]  J 

for  x^  and  x^  do  not  exceed  B^  or  B^). 

Suppose  now  that  the  relation  between  x^  and  x^  stated  in  Proposi¬ 
tion  8  also  holds  between  other  (not  necessarily  disjoint)  pairs  of  vari¬ 
ables.  Creating  the  appropriate  linear  function  L(x)  for  each  such  pair 

affords  the  conclusion  that  x .  m£^  be  bounded  from  above  by  the  smallest 

J 

of  the  upper  bounds  that  apply  by  Proposition  8,  provided  this  smallest 

upper  bound  is  S  B . .  V/e  now  seek  an  expedient  way  to  determine  the 

(] 

smallest  of  these  bounds  for  each  j . 

Proposition  9»  Let  k^  be  the  least  positive  integer  such  that,  for 
some  integer  h  ^  0,  k^A^  =  hA^  and  k^Cg  ^  hc^.  Moreover,  let  h^ 
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be  the  smallest  integer  h  satisfying  these  relations.  Similarly, 
let  h^  be  the  least  positive  integer  such  that,  for  some  integer 
k  >  0,  h^Aj^  -  kAg  and  h^c^  >  kc^,  and  let  k^  be  the  smallest  k 
satisfying  these  relations .  (Alternately,  we  may  require  > 
h^Cj^  and  h^c^^  ^  k^c^.)  Then  h^k^  <  h^k^  and,  moreover,  h^  <  h^, 
k^  <  k^. 

Proof.  First,  observe  that  h^  g  h^  and  ^  k^  is  impossible. 

For  otherwise  we  have  k2C2  <  h^c^  ^  ^1^1  ~  ^1^2  ^  ^*^2’  ^2^2  ^ 

kgCg.  Thus,  either  h^  <  h^  or  k^  <  k^^.  Suppose  h^  <  h^  but  k^ 

^  k^.  Then  (k^  -  k^)c2  <  (h^  -  and  (k^  -  k^)A2  =  (kg  “ 


wliere  k^  > 


k^  -  k^  ^0,  h^  ^  hg  -  h^  >  0.  But  then  by  the  defini¬ 


tion  of  hg  we  have  h^  -  h^  =  h^  and  thus  k^  -  k^  “  latter 

being  impossible.  Consequently,  h^  <  h^  ij!q)lies  k^  <  k^.  On  the 
other  hand,  if  k^  <  k^  and  h^  ^  h^,  then  (k^  -  1^2)02  >  .{h^  -  ^2)0^ 
and  (k^  -  k2)A2  =  (h^  -  k2)A^.  In  this  case  we  obtain  a  contradic¬ 
tion  by  observing  that  h^  >  h^  -  h2  =  h^  follows  from  the  definition 
of  k^  and  h^.  Thus  we  conclude  h^  <  h2,  k2  <  k^,  and,  of  course, 
h^k2  <  k2kj^. 


One  inmediate  consequence  of  Proposition  9  is  that  for  h^,  h^,  k^, 

k2  as  indicated,  it  is  inq)ossible  to  find  h,  k  not  both  zero  such  that 

h2  >  h  >  0,  k^  >  k  S  0  and  hA^  e:  kA2.  Moreover,  h^,  h2,  k^,  kg  may 

always  be  determined  to  satisfy  the  conditions  of  Proposition  9  as  long 

as  c^,  Cg  >  0.  This  means  that  we  are  provided  with  natural  bounds  = 

hg  -  1  and  Bg  =  k^  -  1  such  that  B^  Bg  <  D,  where  D  is  the  order  of  the 

additive  group  generated  by  the  A..  {\le  assume  that  if  exogenous  bounds 

J 

B^  and  Bg  exist,  then  B^  ^  B^,  Bg  ^  Bg.)  This  result  extends  to  any 
number  of  variables,  since  if  hA^  =  kA^  for  nonnegative  h  and  k  not  both  0, 
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it  is  irnmediate  by  Propositions  8  and  9  that  either  i  h  -  1  or  i  k  -  1 


can  be  enforced.  By  a  process  of  scanning,  then,  one  selects  bounds  B 


such  tlmt  x_.  S  Bj  and 
that 


J 

V...-  /  '  Dj  provided  B.  B . .  Gonory  has  pointed  out 

^x^  S  D  -  1  may  be  enforced  for  an  optimal  solution  to  (2).  V/e 
have  here  indicated  a  way  to  determine  bounds  on  the  x^  that  satisfy  this 
inequality  (provided  exogenous  bounds  are  nonbinding).  One  of  the  chief 
values  of  this  result,  however,  lies  in  the  fact  that  it  provides  a  con¬ 
venient  v;ay  to  check  whether  some  of  the  exogenous  B.  may  actually  be  re- 
placed  by  natural  (and  possibly  smaller)  upper  bounds. 

Another  use  for  Propositions  8  and  9  occurs  when  y  x^  is  bounded 
above.  In  this  event,  the  upper  bounds  x^  $  h^  -  1,  x^  2  -  1  still 

apply  provided  h^  S  k^  and  5  h^.  It  is  to  be  noted  that  these  latter 
inequalities  may  occur  for  h^,  h^,  k^,  k^  satisf;>lng  Proposition  8  but  not 
Proposition  9* 

In  the  scanning  of  the  A.^  and  their  multiples  to  determine  bounds  on 
the  Xj,  there  is  another  result  that  may  be  useful.  If  h^  is  the  least 
positive  (integer)  multiple  of  such  that  h^A^  =  kA^  for  some  k,  then 
the  only  positive  multiples  h  of  A^  that  satisfy  hA^^  eh  kA^,  for  some  k, 

are  h  »  h^,  2h^,  3h^,  etc.  To  see  this,  suppose  hA^  eh  kAg  for  h  =  rh^  +  q, 

where  r  is  any  positive  multiple  and  0  ^  q  <  h^.  Then  qA^  =  (k  -  rk^)A2, 

where  =  h^A^.  By  the  definition  of  h^  it  follows  that  q  =  0. 


9.  Concluding  Remarks 

The  chief  focus  of  this  paper  has  been  on  developing  an  algorithm 
for  solving  problem  (2)  when  certain  additional  constraints  apply. 
Gomory's  api^roach  [5]  to  solving  this  problem  in  the  absence  of  such 
constraints  is  to  use  the  dynamic  programming  recursion 

^^(z)  =  Min(0^_^(z),  0j(z  -  Aj)  +  Cj),  J  =  1,  •••>  n. 


where  0.(0)  =0,  0  (z)  =  »,  and  z  ranges  over  the  elements  of  the  addi- 
<J  o 

tive  group  generated  by  the  A.  nod  1.  If  0.(z  -  A.)  is  unJmam,  then 
one  may  provisionally  replaced  it  by  0.  (z  -  A.)  and  be  assured  that 

t)  J 

computing  0.(z  +  k/i. . )  based  upon  this  replacement  for  1:  =  0,  1, 

will  yield  the  correct  value  of  0.(z  -  A.)  for  the  value  of  k  such  that 

J  1 

z  +  kA  .  =  z  -  A  . . 

J  J 

As  VA  W.  VJhite  points  out  [6].  it  is  possible  to  determine  0  (z  + 
kA^ )  correctly  for  all  k  without  the  need  for  revision.  To  do  this  one 
identifies  h  such  that  0.  (z  +  hA . )  =  Min(0._,(z  -i-  and  defines  0. 

(z  +  hAj )  =  0j  ^(z  +  ^j)-  ^n^^o^  then  gives  the  optimal  objective  func¬ 
tion  value  for  (2),  Backtracking  over  the  to  find  an  optimal  x 

occurs  in  a  manner  related  to  that  outlined  in  Section  5  by  recording 
for  each  0j(z)  the  largest  k  such  that  Xj^  =  1. 

Our  motivation  in  developing  the  algorithm  of  this  paper  has  not 
been  to  devise  a  method  that  is  competitive  in  efficiency  with  Gomory’s 
when  applied  to  (2)  in  the  absence  of  additional  constraints.  Neverthe¬ 
less,  our  method  may  be  competitive  in  this  limited  context  due  to  the 
fact  that  it  may  generate  A^  somewhat  in  advance  of  generating  all  the 
other  elements  of  the  finite  additive  group,  particularly  if  the  varia¬ 
tion  of  Section  6  is  used.  The  Gomory  approach,  on  the  other  hand,  must 
generate  0.(z)  for  each  z  in  the  group  and  for  each  j  except  possibly  for 
j  =  n.  It  may  be  noted  that  the  values  constitute  a  superset  of 

the  c(i)  generated  by  the  algorithm  of  this  paper. 

Once  problem  (2)  becomes  complicated  with  restrictions  of  the  form 

X  ^  B.,  however,  the  dynamic  programming  recursion  just  outlined  no 
J  J 

longer  suffices,  and  it  appears  necessary  to  resort  to  the  more  familiar 


Bellman  knapsack  recursion 


4o 


P^U)  =  Min  -  AjXj)  +  CjX.  I  0  .  Xj  .  B.j. 

i 

In  addition  to  being  rather  demanding  on  memory  capacity,  it  is  evident 
that  this  approach  can  require  considerably  more  computation  than  the 
earlier  recursion  unless  the  average  of  the  is  not  too  far  from  1. 

The  treatment  of  exogenous  upper  bounds  in  our  approach  requires, 
by  comparison,  very  moderate  storage  capacity.  In  addition,  although 
these  bounds  may  sometimes  entail  more  computation  than  would  be  re¬ 
quired  in  their  absence,  they  may  also  sometimes  entail  less.  This  is 
due  to  the  fact  that  their  existence  may  rule  out  the  generation  of  cer¬ 
tain  x(i)  that  would  otherwise  occur  in  the  solution  sequence. 

There  appears  to  be  little  promise  in  the  customary  dynamic  program¬ 
ming  approach  to  handling  other  kinds  of  restrictions,  since  the  amount 
of  computation  and  memory  requirements  in  such  applications  are  typically 
quite  large. 

V/e  might  note,  in  passing,  that  our  method  can  be  employed  in  the 
framework  of  a  cutting  approach.  The  optimal  solution  to  (2)  --  or  to 
(2)  augmented  by  some  of  the  restrictions  of  (l)  --  provides  a  lower 
bound  L  such  that  cx  S  L  in  the  optimal  solution  to  (l).  One  may  find 
successively  larger  integer  values  for  L  by  solving  (l)  as  a  linear  pro¬ 
gram  with  the  constraint  cx  ^  L  adjoined,  and  then  reapplying  the  method 
of  this  paper.  The  method  may  clearly  be  adapted  to  solve  for  all  optimal 
solutions  to  (2)  or  (3),  thereby  assuring  that  L  may  always  be  incremented 
by  at  least  1  (assuming  that  c  initially  consists  o^  integers). 

More  generally,  any  linear  form  in  the  nonbasic  variables  with  posi¬ 
tive  coefficients  (and  possibly  some  zero  coefficients  temporarily  per¬ 
turbed),  can  replace  the  objective  function  of  (3).  The  optimal  value 
for  this  modified  objective  function  —  or  a  lower  bound  on  this  optimal 


kl 


value  obtained  by  the  method  at  some  convenient  cutol'f  point  --  can  be 

used  to  transfou.i the  linear  form  directly  into  a  cut.^  If  the  problem 

has  a  fAw.-ct  of  constraints  of  the  form  )  a.x.  a  ,  vrhere  s. .  ^  0-  for  j 

^  r,  then  a  cut  can  also  be  obtained  by  minimizinc  a  linear  form  over 

the  X.  for  j  >  r,  provided  all  constraints  )  a.x.  =  a  v/ith  a.  ^  0  for 
J  ’  '  Z>  0  0  o  0  ^ 

2 

j  S  r  arc  disregarded.  It  may  be  noted  that  the  variation  of  Section  6 
may  provide  a  particularly  effective  vray  to  determine  a  cut.  If  an  opti¬ 
mal  solution  hasn't  been  found  upon  reaching  a  specified  cutoff,  it  fol¬ 
lows  from  Proposition  7  that  one  may  impose  the  cut^c^x^  ^  Max(c(i), 
2c(i)  -  Cj^),  where  x(i)  is  the  last  solution  generated.  VIhen  the  linear 
form  minimized  is  )  x.,  this  of  course  becomes  )x.  ^2)x^-l. 


It  is  assumed  that  the  coefficients  of  the  linear  form  are  selected 
so  that  the  slack  variable  of  the  cut  will  be  integer  valued. 

2 

One  can  take  advantage  of  these  latter  constraints,  however,  by 
following  the  approach  of  the  footnote  on  page  32. 


42 


References 


1.  Dantzig,  G.  B. ,  "On  the  Shortest  Route  Through  A  Network," 

Management  Science,  Vol.  6,  No.  2,  i960. 

2.  Gilmore,  P.  C.,  and  R.  E.  Gomory,  "14iilti-Stage  Cutting  Stock 

Problems  of  Two  and  More  Dimensions,"  Operations  Research, 

Vol.  15,  1965. 

3.  Glover,  Fred,  "Truncated  Enumeration  Methods  for  Solving  Pure 

and  Mixed  Integer  Linear  Programs,"  Working  Paper,  Operations 
Research  Center,  University  of  California,  Berkeley,  May  I966. 

4.  Gomory,  R.  E. ,  "An  Algorithm  for  Integer  Solutions  to  Linear 

Programs,"  in  R.  L.  Graves  and  P.  V7olfe,  eds..  Recent  Advances 
in  tfe thema ti cal  Programming ,  l«IcGraw-Hill  Book  Company,  Inc., 

I96F: 

5.  Gomory,  R.  E.,  "On  the  Relation  Betv.'een  Integer  and  Koninteger 

Solutions  to  Linear  Programs,"  Proceedings  of  the  National 
Academy  of  Sciences,  Vol.  55^  1963. 

6.  White,  William  W.,  "Integer  Linear  Programming:  Relations  Between 

Discrete  and  Continuous  Solutions,"  ORC  66-27,  1966. 


Uncleiss  i  f  icci _ 

Security  ClcSKSification 

...  daTa  •  R&D  '  ’ 

(Security  ctnuaificedoti  ot  title,  body  of  tmd  indexing  emrtotutiou  mtisf  be  entered  w'hcn  the  ovoroll  report  is 


■!■  n  ibi  h 

cinssifiod)  I 


1  -  OS5IGIN  ATIN  G  ACTJVITY  (Corporate  author) 

University  of  California,  Berkeley 


2«  REPORT  SECUniTV  CLASSIFICATION 

Unclass i f ied 


3  REPORT  TITLE 

AN  ALGORITHM  FOR  SOLVING  THE  LINEAR  INTEGER  PROGRAMING  PROBLEM  OVER  A  FINITE 
ADDITIVE  GROUP,  WITH  EXTENSIONS  fO  SOLVING  GENERAL  LINEAR  AND  CERTAIN  NONLINEAR 
INTEGER  PROGRAMS 


4-  DESCRIPTIVE  NOTES  (Tvpe  of  report  and  Inclusive  dates) 

Research  Report 


S  AUTHOnr^^  nanio.  first  name,  initial) 

Glover,  Fred 


6  riCPO  RT  DATE 

September  1966 


6a.  CONTRACT  OR  GRANT  NO. 

Nonr-222(83) 

b.  PROJEC  T  NO. 

NR  047  033 

C. 

^Research  Project  No.  RR  C03-07-01 


\0  A  VA  IL  ABILITY/LIMITATION  NOTICES 


7a.  TOTAL  NO.  OF  PACF.S  7  6.  NO  OF  REFS 


9a.  ORIGINATOR'S  REPORT  NUMBERS’S; 


ORC  66-29 


9  6-  OTHER  REPORT  uO(S)  (A  ny  other  numbers  that  may  be  essiCr^ed 
this  report) 


Available  without  limitation  on  dissemination 


11.  SUPPLEMENTARY  NOTES 


12.  SPON.SORING  MILITARY  ACTIVITY 


See  bottom  of  title  page 


Mathematical  Science  Division 


13  ABSTRACT 


See  Abstract  Page 


DD  1473 


Unclass i f ied _ 

Security  Classification 


Unclassified 


Security  Classification 


14. 

LINK  A 

LINK  B 

LINK  C  T 

KEY  WORDS 

ROLE  1  WT 

ROLE  1  WT 

ROLE  1  WT  J 

Integer  Programming 
Truncated  Enumeration 
Gomory  Additive  Group 
"Least  Cost"  Algorithm 


INSTRUCTIONS 


1.  ORIGINATING  ACTIVITY:  Enter  the  name  and  address 
of  the  contractor,  subcontractor,  grantee,  Department  of  De¬ 
fense  activity  or  other  organization  (corporate  author)  issuing 
the  report. 

2a.  REPORT  SECUKTY  CLASSIFICATION:  Enter  the  over¬ 
all  security  classification  of  the  report.  Indicate  whether 
“Restricted  Data”  is  included.  Marking  is  to  be  in  accord¬ 
ance  with  appropriate  security  regulations. 

2b.  GROUP:  Automatic  downgrading  is  specified  in  DoD  Di¬ 
rective  S200. 10  and  Armed  Forces  Industrial  Manual.  Enter 
the  group  number.  Also,  when  applicable,  show  that  optional 
markings  have  been  used  for  Group  3  and  Group  4  as  author¬ 
ized. 

3.  REPORT  TITLE:  Enter  the  complete  report  title  in  all 
capita]  letters.  Titles  in  all  cases  should  be  unclassified. 

If  a  iiicaningful  title  carmot  be  selected  without  classifica¬ 
tion,  show  title  classification  in  all  capitals  in  parenthesis 
imnirdiatcly  following  the  title. 

4.  DESCRIPTIVE  NOTES;  If  appropriate,  enter  the  type  of 
report,  e.  g. ,  interim,  progress,  summary,  annual,  or  final. 

Give  the  inclusive  dates  when  a  specific  reporting  period  is 
covered. 

5.  AUTIIOR(S):  Enter  the  narr.c(s)  of  authoKa)  as  shown  on 
or  in  the  report.  Entei  last  name,  first  name,  middle  initial. 

If  military,  show  rank  and  branch  of  service.  The  name  of 
the  principal  onthor  is  an  absolute  arinimum  requirement. 

6.  REPORT  DATE:  Enter  the  date  of  the  report  as  day, 
month,  year;  or  month,  year.  If  more  than  one  date  appears 
on  the  report,  use  date  of  publication. 

7a.  TOTAL  NUMHER  OF  PAGES:  The  total  page  count 
should  follow  normal  pagination  procedures,  i.  e. ,  enter  the 
number  of  pages  containing  information. 

I  76.  NUMIiER  OF  REFERENCES:  Enter  the  total  number  of 
references  cited  in  the  report. 

8a.  CONTRACT  OR  GRANT  NUMBER:  If  appropriate,  enter 
the  applicable  number  of  the  contract  or  grant  under  which 
the  report  was  written. 

66,  6i  Bd.  PROJECT  NUMBER:  Enter  the  appropriate 
military  department  identification,  such  ns  project  number, 
subproject  numlier,  system  numbers,  task  number,  etc. 

9e.  ORIGINATXTR’S  REPORT  NUHBER(S):  Enter  the  offi¬ 
cial  report  number  by  which  the  document  will  be  identified 
and  controlled  by  the  originating  activity.  This  number  must 
be  unique  to  this  report. 

06.  OTHER  REPORT  NU.MBER(S):  If  the  report  has  been 
assigned  any  other  report  numbers  (either  by  the  originator 
or  by  the  sponxor),  elso  enter  this  numbcr(s). 

10.  AVAILABILITY/LIMITATION  NOTICES;  Enter  any  lim¬ 
itations  on  further  dissemination  of  the  report,  other  than  those 


imposed  by  security  classification,  using  standard  statements 
such  as; 

(1)  “Qualified  requesters  may  obtain  copies  of  this 
report  from  DDC" 

(2)  “Foreign  announcement  and  dissemination  of  this 
report  by  DDC  is  not  authorized.” 

(3)  “U.  S.  Government  agencies  may  obtain  copies  of 
this  report  directly  from  DDC.  Other  qualified  DDC 
users  shall  request  through 

II 


(4)  “U.  S.  military  agencies  may  obtain  copies  of  this 
repert  directly  from  DDC.  Other  qualified  users 
shall  request  through 

II 

(5)  “All  distribution  of  this  report  is  controlled.  Qual¬ 
ified  DDC  users  shall  request  through 

II 

If  the  report  has  been  furnished  to  the  Office  of  Technical 
Services,  Department  of  Commerce,  for  sale  to  the  public,  indi¬ 
cate  this  fact  and  enter  the  price,  if  known, 

11.  SUPPLEMENTARY  NOTES:  Use  for  additional  explana¬ 
tory  notes. 

12.  SPONSORING  MILITARY  ACTIVITY:  Enter  the  name  of 
the  departmental  project  office  or  laboratory  sponsoring  (pay¬ 
ing  forj  the  research  and  development.  Include  address. 

13.  ABSTRACT:  Enter  an  abstract  giving  a  brief  and  factual 
summary  of  the  document  indicative  of  the  report,  even  though 
it  may  also  appear  elsewhere  in  the  body  of  the  technical  re¬ 
port.  If  additional  space  is  required,  a  continuation  sheet  shall' 
be  attached. 

It  is  highly  desirable  that  the  abstract  of  classified  reports 
be  unclassified.  Each  p.sragraph  of  the  abstract  shell  end  with 
an  indication  of  the  military  security  classification  of  the  in¬ 
formation  in  the  paragraph,  represented  as  (TS),  (S),  (C),  or  (U). 

There  is  no  limitation  on  the  length  of  the  abstract.  How¬ 
ever,  the  suggested  length  is  from  150  to  225  words. 

14-  KEY  WORDS:  Key  words  are  technically  meaningful  terms 
or  short  phrases  that  characterize  a  report  end  may  bo  used  as 
index  entries  for  cataloging  the  report.  Key  words  must  be 
selected  so  that  no  security  classification  is  required.  Identi¬ 
fiers,  such  as  equipment  model  designation,  trade  name,  military 
project  code  name,  geographic  location,  may  be  used  as  key  I 
words  but  will  be  follov/ed  by  an  indication  of  technical  con-  | 
text.  The  cssignment  of  links,  roles,  and  weights  is  optional.  j 


DD  1473  (BACK) 


Unclass i f led _ 

Security  Classification 


